-- Logs begin at Tue 2022-09-20 04:12:53 UTC, end at Tue 2022-09-20 05:15:11 UTC. -- Sep 20 04:43:22.358945 dv-cinder-756710-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 20 04:43:22.366353 dv-cinder-756710-7-iscsi devstack@n-api.service[111809]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 20 04:43:22.370108 dv-cinder-756710-7-iscsi devstack@n-api.service[111809]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 20 04:43:22 2022] *** Sep 20 04:43:22.370108 dv-cinder-756710-7-iscsi devstack@n-api.service[111809]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 20 04:43:22.370108 dv-cinder-756710-7-iscsi devstack@n-api.service[111809]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 20 04:43:22.370108 dv-cinder-756710-7-iscsi devstack@n-api.service[111809]: nodename: dv-cinder-756710-7-iscsi Sep 20 04:43:22.370108 dv-cinder-756710-7-iscsi devstack@n-api.service[111809]: machine: x86_64 Sep 20 04:43:22.370108 dv-cinder-756710-7-iscsi devstack@n-api.service[111809]: clock source: unix Sep 20 04:43:22.370108 dv-cinder-756710-7-iscsi devstack@n-api.service[111809]: pcre jit disabled Sep 20 04:43:22.370108 dv-cinder-756710-7-iscsi devstack@n-api.service[111809]: detected number of CPU cores: 4 Sep 20 04:43:22.370108 dv-cinder-756710-7-iscsi devstack@n-api.service[111809]: current working directory: / Sep 20 04:43:22.370108 dv-cinder-756710-7-iscsi devstack@n-api.service[111809]: detected binary path: /usr/bin/uwsgi-core Sep 20 04:43:22.370108 dv-cinder-756710-7-iscsi devstack@n-api.service[111809]: your processes number limit is 47680 Sep 20 04:43:22.370108 dv-cinder-756710-7-iscsi devstack@n-api.service[111809]: your memory page size is 4096 bytes Sep 20 04:43:22.370108 dv-cinder-756710-7-iscsi devstack@n-api.service[111809]: detected max file descriptor number: 2048 Sep 20 04:43:22.370108 dv-cinder-756710-7-iscsi devstack@n-api.service[111809]: lock engine: pthread robust mutexes Sep 20 04:43:22.370937 dv-cinder-756710-7-iscsi devstack@n-api.service[111809]: thunder lock: enabled Sep 20 04:43:22.370937 dv-cinder-756710-7-iscsi devstack@n-api.service[111809]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 20 04:43:22.370937 dv-cinder-756710-7-iscsi devstack@n-api.service[111809]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 20 04:43:22.410585 dv-cinder-756710-7-iscsi devstack@n-api.service[111809]: Python main interpreter initialized at 0x5584732ea9c0 Sep 20 04:43:22.410585 dv-cinder-756710-7-iscsi devstack@n-api.service[111809]: python threads support enabled Sep 20 04:43:22.410585 dv-cinder-756710-7-iscsi devstack@n-api.service[111809]: your server socket listen backlog is limited to 100 connections Sep 20 04:43:22.410585 dv-cinder-756710-7-iscsi devstack@n-api.service[111809]: your mercy for graceful operations on workers is 90 seconds Sep 20 04:43:22.410989 dv-cinder-756710-7-iscsi devstack@n-api.service[111809]: mapped 403077 bytes (393 KB) for 2 cores Sep 20 04:43:22.411102 dv-cinder-756710-7-iscsi devstack@n-api.service[111809]: *** Operational MODE: preforking *** Sep 20 04:43:22.411378 dv-cinder-756710-7-iscsi devstack@n-api.service[111809]: *** uWSGI is running in multiple interpreter mode *** Sep 20 04:43:22.411378 dv-cinder-756710-7-iscsi devstack@n-api.service[111809]: spawned uWSGI master process (pid: 111809) Sep 20 04:43:22.411593 dv-cinder-756710-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 20 04:43:22.413413 dv-cinder-756710-7-iscsi devstack@n-api.service[111809]: spawned uWSGI worker 1 (pid: 111810, cores: 1) Sep 20 04:43:22.413413 dv-cinder-756710-7-iscsi devstack@n-api.service[111809]: spawned uWSGI worker 2 (pid: 111811, cores: 1) Sep 20 04:43:22.413413 dv-cinder-756710-7-iscsi devstack@n-api.service[111809]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 20 04:43:23.069318 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 20 04:43:23.069917 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 20 04:43:24.154256 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 20 04:43:24.154256 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: from cryptography.utils import int_from_bytes Sep 20 04:43:24.154832 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 20 04:43:24.154832 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: from cryptography.utils import int_from_bytes Sep 20 04:43:24.156132 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 20 04:43:24.156132 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: from cryptography.utils import int_from_bytes Sep 20 04:43:24.156132 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 20 04:43:24.156132 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: from cryptography.utils import int_from_bytes Sep 20 04:43:26.627313 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 20 04:43:26.627875 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 20 04:43:26.628090 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 20 04:43:26.628448 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 20 04:43:26.628734 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 20 04:43:26.629118 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.629442 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.629763 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.630080 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.630410 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.630721 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.631044 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.631361 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.631693 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.631928 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 20 04:43:26.632310 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.632399 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 20 04:43:26.632478 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.632563 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-756710-7-iscsi {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.632778 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 20 04:43:26.633630 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 20 04:43:26.633814 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.633902 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 20 04:43:26.634132 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.634263 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.634448 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.634591 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.634774 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.634914 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.635083 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.635234 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.635409 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.635563 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.635719 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.635874 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.636194 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.636324 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.636520 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.636692 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.636874 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.636996 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.637134 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.637304 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.637452 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.637644 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.637779 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-756710-7-iscsi {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.637962 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.638092 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.638274 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.638401 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.638596 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.638734 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.638907 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.639040 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.639251 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.639372 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.639542 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.639683 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.639895 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.640026 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-756710-7-iscsi {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.640243 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.640414 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.640558 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.640752 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.640879 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.641062 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.641288 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.641412 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.641600 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.641732 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.641953 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.642088 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.642217 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.642340 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.642557 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.642692 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.642866 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.642992 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.643195 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.643407 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.643539 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.643668 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.643824 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.643961 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-756710-7-iscsi {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.644145 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.644271 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.644450 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.644576 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.644788 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.644915 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.645099 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.645233 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.645420 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.645552 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.645727 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.646130 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.646314 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.646440 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.646571 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.646718 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.646852 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.647026 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.647174 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.647355 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.647496 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.647683 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.647817 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.648004 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.648130 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.648306 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.648431 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.648652 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.648782 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.648967 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.649092 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.649273 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.649439 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.649585 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.649715 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.649889 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.650023 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.650195 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.650328 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.650451 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.650578 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.650742 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.650874 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.651065 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.651204 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.651379 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.651503 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.651734 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.651867 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.652010 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.652141 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.652263 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.652386 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.652506 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.652667 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.652802 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.652953 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.653117 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.653350 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.653476 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.653598 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.653728 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.653902 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.654034 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.654239 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.654364 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.654559 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.654685 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.654868 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.654995 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.655187 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.655319 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.655503 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.655635 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.655809 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.655940 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.656117 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.656242 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.656426 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.656553 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.656772 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.656906 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.657172 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.657304 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.657442 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.657573 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.657717 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.657841 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.658021 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.658146 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.658327 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.658460 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.658646 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.658772 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.658957 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.659093 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.659264 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.659438 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.659564 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.659686 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.659857 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.659997 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.660163 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.660287 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.660468 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.660593 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.660801 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.660940 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.661109 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.661235 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.661355 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.661475 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.661654 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.661788 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.661959 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.662085 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.662279 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.662412 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.662588 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.662722 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.662893 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.663022 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.663199 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.663332 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.663500 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.663627 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.663808 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.663933 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.664138 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.664276 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.664444 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.664569 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.664777 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.664891 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.665086 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.665199 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.665393 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.665510 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.665698 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.665808 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.666007 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.666120 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.666312 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.666430 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.666616 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.666734 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.666933 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.667045 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.667243 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.667356 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.667550 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.667661 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.667863 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.667983 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.668162 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.668280 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.668470 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.668581 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.668811 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.668922 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.669122 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.669235 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.669428 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.669593 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.669736 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.669871 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.670041 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.670152 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.670348 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.670466 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.670654 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.670777 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.670957 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.671070 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.671262 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.671373 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.671564 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.671684 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.671869 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.671989 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.672224 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.672339 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.672542 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.672723 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.672878 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.672989 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.673181 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.673321 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.673491 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.673628 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.673798 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.673925 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.674107 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.674233 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.674414 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.674548 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.674720 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.674856 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.675025 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.675151 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.675327 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.675454 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.675648 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.675782 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.675973 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.676105 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.676285 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.676420 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.676593 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.676735 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.676919 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.677054 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.677240 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:43:26.677365 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.677555 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.677678 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.677874 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.678009 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.678195 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.678323 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.678529 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.678658 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.678848 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.678994 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.679165 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.679298 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.679505 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.680158 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.680301 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.680451 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.680631 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.680760 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.680959 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.681087 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.681274 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.681423 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.681585 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.681709 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.681897 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.682022 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.682217 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.682352 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.682540 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.682678 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.682874 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.683001 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.683196 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.683323 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.683507 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.683630 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.683817 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.683943 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.684129 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.684256 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.684451 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.684577 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.684796 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.684920 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.685109 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.685237 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.685420 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.685543 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.685731 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.685853 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.686055 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.686181 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.686371 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.686505 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.686684 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.686819 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.686998 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.687123 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.687311 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.687437 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.687624 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.687758 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.687934 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.688057 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.688262 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.688386 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.688583 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.688759 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.688911 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.689031 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.689224 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.689362 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.689612 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.689756 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.689879 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.690010 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.690169 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.690293 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.690443 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.690579 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.690750 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.690877 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.691056 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.691195 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.691362 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.691498 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.691673 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.691801 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.691985 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.692110 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.692309 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.692433 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.692666 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.692795 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.692917 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.693049 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.693254 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.693380 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.693561 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.693685 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.693870 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.693994 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.694178 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.694303 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.694483 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.694616 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.694787 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.694923 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.695090 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.695813 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.695948 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.696072 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.696253 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.696387 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.696574 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.696728 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.696907 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.697032 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.697215 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.697350 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.697540 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.697675 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.697848 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.697974 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.698156 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.698291 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.698468 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.698592 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.698778 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.698910 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.699083 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.699208 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.699394 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.699524 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.699696 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.699829 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.700002 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.700130 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.700317 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.700451 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.700643 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.700784 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.700954 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.701086 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.701277 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.701404 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.701585 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.701719 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.701895 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.702032 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.702211 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.702345 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.702526 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.702658 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.702830 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.702956 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.703139 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.703273 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.703443 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.703578 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.703748 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.703874 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.704054 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.704173 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.704364 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.704530 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.704702 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.704838 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.705008 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.705143 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.705310 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.705445 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.705611 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.705738 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.705912 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.706038 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.706234 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.706361 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.706541 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.706667 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.706851 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.706976 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.707155 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.707281 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.707457 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.707584 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.707795 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.707923 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.708078 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.708213 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.708381 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.708508 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.708709 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.708837 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.709014 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.709142 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.709317 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.709444 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.709619 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.709754 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.709942 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.710076 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.710251 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.710414 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.710562 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.710697 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.710891 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.711027 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.711196 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.711330 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.711514 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.711647 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.711825 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.711958 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.712150 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.712276 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.712460 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.712622 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.712810 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.712936 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.713120 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.713258 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.713431 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.713558 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.713734 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.713857 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.714045 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.714181 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.714357 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.714485 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.714667 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.714793 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.714978 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.715104 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.715299 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.715435 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.715609 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.715734 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.715925 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.716059 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.716234 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.716359 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.716541 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.716719 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.716879 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.717003 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.717188 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.717313 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.717491 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.717623 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.717802 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.717934 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.718120 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.718254 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.718429 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.718562 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.718751 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.718886 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.719061 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.719188 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.719371 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.719495 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.719674 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.719808 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.719987 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.720114 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.720297 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.720453 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.720624 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.720770 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.720938 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.721064 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.721256 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.721379 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.721576 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.721706 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.721868 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.721995 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.722178 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.722312 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.722488 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.722612 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.722796 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.722920 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.723102 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.723226 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.723406 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.723538 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.723721 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.723846 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.724029 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.724154 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.724339 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.724465 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.724664 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.724803 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.724982 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.725117 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.725291 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.725424 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.725597 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.725722 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.725900 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.726039 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.726209 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.726333 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.726541 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.726667 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.726850 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.726983 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.727160 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.727284 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.727476 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.727603 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.727780 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.727916 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.728085 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.728213 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.728387 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.728511 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.728724 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.728861 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.729030 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.729155 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.729331 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.729455 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.729631 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.729756 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.729939 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.730056 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.730260 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.730387 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.730551 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.730684 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.730865 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.730991 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.731183 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.731310 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.731487 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.731612 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.731790 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.731916 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.732104 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.732237 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.732409 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.732528 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.732738 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.732876 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.733043 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.733179 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.733347 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.733474 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.733654 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.733779 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.733963 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.734097 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.734271 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.734397 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.734578 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.734705 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.734898 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.735032 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.735203 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.735331 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.735513 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.735640 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.735819 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.735953 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.736118 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.736242 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.736427 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.736554 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.736753 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.736878 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.737058 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.737335 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.737463 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.737669 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.737805 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.737977 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.738102 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.738289 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.738415 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.738612 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.738748 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.738920 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.739055 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.739232 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.739358 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.739541 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.739679 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.739845 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.739972 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.740155 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.740287 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.740464 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.740660 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.740800 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.741047 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.741175 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.741384 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.741511 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.741687 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.741814 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.742000 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.742629 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.742876 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.743015 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.743193 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.743318 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.743499 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.743627 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.743805 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.743932 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.744110 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.744245 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.744416 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.744543 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.744755 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.744882 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.745059 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.745195 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.745362 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.745488 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.745667 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.745791 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.745973 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.746172 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.746297 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.746420 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.746571 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.746697 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.746870 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.747004 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.747171 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.747296 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.747475 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.747609 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.747783 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.747911 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.748089 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.748225 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.748403 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.748542 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.748737 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.748863 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.749031 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.749160 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.749338 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.749465 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.749660 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.749787 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.749968 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.750101 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.750270 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.750402 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.750572 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.750731 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.750861 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.750984 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.751174 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.751312 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.751477 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.751609 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.751817 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.751944 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.752089 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.752229 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.752398 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.752533 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.752728 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.752857 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.753034 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.753170 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.753341 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.753468 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.753641 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.753776 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.753957 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.754084 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.754257 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.754388 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.754556 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.754682 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.754857 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.754985 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.755158 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.755283 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.755463 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.755596 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.755767 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.755895 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.756074 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.756206 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.756374 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.756509 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.756693 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.756825 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.756996 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.757131 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.757297 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.757422 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.757603 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.758293 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.758449 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.758583 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.758753 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.758889 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.759056 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.759182 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.759366 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.759498 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.759674 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.759810 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.759976 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.760108 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.760280 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.760407 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.760582 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.760778 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.760905 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.761039 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.761199 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.761325 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.761502 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.761635 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.761806 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.761932 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.762115 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.762249 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.762421 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.762553 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.762721 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.762871 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.763023 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.763146 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.763328 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.763455 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.763629 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.763754 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.763930 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.764054 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.764230 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.764362 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.764531 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.764679 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.764856 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.764982 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.765160 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.765287 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.765465 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.765591 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.765785 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.765917 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.766090 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.766215 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.766395 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.766528 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.766698 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.766831 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.766998 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.767130 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.767299 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.767424 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.767611 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.767745 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.767915 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.768043 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.768218 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.768344 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.768521 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.768680 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.768847 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.768975 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.769151 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.769281 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.769473 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.769633 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.769780 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.769907 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.770087 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.770215 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.770392 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.770527 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.770694 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.771112 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.771271 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.771396 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.771578 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.771712 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.771889 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.772015 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.772211 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.772338 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.772524 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.772688 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.772861 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.772980 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.773172 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.773334 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.773510 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.773636 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.773825 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.773959 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.774131 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.774270 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.774447 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.774574 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.774760 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.774887 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.775075 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.775280 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.775407 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.775541 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.775665 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.775787 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.775979 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.776118 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.776318 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.776449 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.776616 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.776743 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.776933 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.777061 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.777244 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.777370 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.777554 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.777687 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.777863 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.777988 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.778171 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.778327 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.778475 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.778599 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.778784 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.778910 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.779095 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.779219 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.779401 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.779535 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.779710 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.779836 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.780013 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.780137 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.780323 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.780460 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.780651 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.780781 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.780959 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.781085 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.781268 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.781404 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.781582 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.781710 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.781893 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.782019 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.782199 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.782333 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.782523 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.782650 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.782831 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.782965 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.783136 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.783270 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.783447 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.783574 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.783754 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.783880 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.784065 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.784192 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.784371 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.784496 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.784791 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.784928 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.785100 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.785234 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.785409 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.785542 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.785714 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.785838 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.786027 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.786153 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.786331 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.786455 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.786639 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.786765 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.786946 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.787073 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.787252 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.787376 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.787566 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.787690 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.787892 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.788019 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.788291 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.788414 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.788700 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.788845 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.789484 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.789607 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.789731 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.789852 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.790049 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.790191 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.790377 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.790511 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.790686 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.790813 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.790995 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.791132 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.791294 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.791426 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.791612 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.791740 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.791920 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.792054 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.792246 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.792393 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.792615 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.792744 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.792942 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.793068 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.793256 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.793395 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.793578 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.793704 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.793889 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.794016 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.794216 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.794345 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.794542 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.794668 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.794857 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.794983 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.795181 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.795310 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.795515 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.795640 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.795831 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.795957 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.796144 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.796272 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.796470 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.796639 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.796819 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.796958 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.797134 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.797271 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.797438 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.797563 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.797752 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.797891 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.798061 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.798188 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.798371 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.798499 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.798689 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.798826 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.798994 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.799119 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.799308 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.799435 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.799627 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.799763 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.799916 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.800044 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.800222 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.800349 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.800528 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.800677 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.800881 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.801009 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.801187 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.801360 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.801495 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.801628 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.801812 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.801946 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.802137 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.802263 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.802456 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.802582 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.802760 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.802898 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.803074 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.803202 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.803381 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.803507 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.803687 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.803814 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.803990 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.804123 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.804292 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.804417 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.805164 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.805297 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.805477 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.805622 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.805799 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.805924 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.806113 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.806238 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.806438 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.806572 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.806747 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.806872 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.807054 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.807179 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.807378 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.807513 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.807695 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.807822 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.808002 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.808136 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.808310 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.808437 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.808644 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.808775 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.808947 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.809071 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.809251 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.809380 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.809562 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.809695 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.809867 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.810007 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.810172 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.810300 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.810475 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.810601 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.810785 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.810911 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.811087 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.811222 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.811392 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.811526 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.811681 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.811817 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.812008 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.812138 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.812311 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.812438 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.812650 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.812790 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.812962 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.813096 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.813268 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.813388 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.813572 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.813706 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.813873 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.813996 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.814175 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.814301 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.814485 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.814624 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.814790 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.814917 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.815096 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.815223 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.815381 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.815509 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.815708 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.815836 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.816012 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.816139 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.816329 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.816462 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.816663 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.816793 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.816972 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.817098 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.817281 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.817418 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.817591 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.817718 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.817901 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.818025 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.818218 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.818346 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.818534 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.818667 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.818842 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.818975 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.819165 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.819358 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.819486 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.819687 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.819814 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.820002 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.820149 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.820341 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.820469 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.820675 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.820804 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.820993 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.821120 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.821307 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.821472 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.821620 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.821747 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.821939 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.822066 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.822250 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.822376 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.822561 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.822764 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.822890 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.823078 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.823205 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.823410 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.823537 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.823730 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.823858 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.824047 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.824174 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.824363 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.824490 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.824701 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.824830 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.825020 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.825147 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.825335 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.825472 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.825651 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.825780 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.825966 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.826100 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.826282 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.826417 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.826595 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.826726 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.826910 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.827037 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.827223 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.827351 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.827534 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.827661 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.827848 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.827983 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.828161 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.828288 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.828471 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.828619 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.828809 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.828937 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.829124 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.829252 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.829438 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.829564 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.829762 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.829959 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.830085 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.830207 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.830380 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.830515 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.830698 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.830834 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.831011 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.831136 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.831321 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.831446 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.831637 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.831843 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.831971 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.832157 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.832284 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.832492 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.832686 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.832845 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.832972 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.833173 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.833300 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.833491 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.833627 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.833811 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.833945 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.834134 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.834261 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.834438 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.834575 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.834742 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.834870 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.835054 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.835182 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.835365 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.835568 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.835695 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.835908 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.836044 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.836245 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.836386 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.836573 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.836717 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.836926 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.837061 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.837235 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.837369 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.837556 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.837767 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.837895 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.838114 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.838249 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.838431 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.838559 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.838756 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.838886 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.839066 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.839201 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.839372 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.839499 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.839681 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.839808 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.839991 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.840129 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.840297 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.840433 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.840632 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.840771 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.840936 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.841077 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.841249 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.841463 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.841637 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.841809 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.841936 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.842126 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.842254 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.842450 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.842576 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.842755 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.842895 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.843066 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.843201 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.843371 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.843498 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.843695 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.843830 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.844002 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.844127 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.844308 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.844433 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.844621 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.844765 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.844948 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.845068 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.845253 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.845378 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.845556 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.845687 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.845864 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.845989 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.846169 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.846296 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.846473 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.846599 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.846773 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.846898 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.847078 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.847210 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.847381 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.847507 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.847691 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.847819 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.848001 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.848126 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.848307 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.848436 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.848634 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.848764 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.848946 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.849089 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.849253 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.849380 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.849556 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.849681 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.849860 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.849993 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.850170 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.850294 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.850473 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.850598 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.850783 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.850921 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.851089 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.851216 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.851966 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.852103 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.852248 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.852382 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.852560 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.852809 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.852937 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.853150 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.853278 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.853476 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.853596 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.853783 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.853908 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.854100 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.854236 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.854411 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.854545 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.854731 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.854863 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.855042 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.855175 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.855351 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.855476 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.855671 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.855795 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.855987 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.856123 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.856300 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.856517 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.856669 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.856878 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.857005 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.857200 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.857329 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.857531 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.857656 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.857842 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.857981 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.858152 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.858280 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.858459 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.858591 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.858766 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.858901 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.859073 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.859198 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.859384 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.859511 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.859693 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.859895 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.860022 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.860143 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.860302 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.860430 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.860633 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.860756 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.860951 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.861089 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.861263 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.861391 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.861575 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.861703 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.861886 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.862058 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.862187 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.862317 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.862494 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.862628 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.862803 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.862927 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.863116 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.863254 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.863426 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.863561 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.863742 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.863861 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.864045 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.864178 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.864392 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.864730 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.864870 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.865053 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.865177 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.865373 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.865500 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.865687 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.865813 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.865999 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.866131 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.866309 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.866433 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.866621 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.866755 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.866941 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.867649 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.867820 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.867946 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.868135 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.868266 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.868442 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.868580 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.868821 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.869134 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.869262 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.869460 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.869596 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.869768 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.869894 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.870076 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.870204 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.870384 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.870519 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.870696 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.870825 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.871017 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.871156 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.871329 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.871464 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.871636 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.871763 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.871941 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.872069 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.872258 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.872396 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.872567 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.872746 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.872899 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.873026 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.873206 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.873334 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.873512 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.873638 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.873823 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.873950 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.874128 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.874256 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.874432 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.874560 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.874738 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.874873 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.875042 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.875170 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.875346 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.875472 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.875647 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.875780 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.875957 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.876085 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.876261 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.876387 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.876567 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.876726 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.876895 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.877021 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.877200 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.877368 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.877499 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.877630 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.877805 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.877932 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.878119 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.878246 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.878426 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.878562 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.878731 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.878858 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.879036 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.879164 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.879341 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.879469 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.879649 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.879776 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.879955 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.880090 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.880261 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.880389 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.880566 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.880742 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.880894 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.881032 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.881200 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.881329 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.881522 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.881647 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.881834 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.881969 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.882146 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.882309 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.882461 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.882588 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.882794 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.882928 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.883104 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.883236 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.883414 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.883546 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.883736 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.883865 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.884042 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.884177 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.884363 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.884497 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.884702 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.884848 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.885022 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.885150 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.885334 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.885452 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.885647 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.885775 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.885958 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.886084 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.886267 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.886393 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.886577 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.886703 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.886885 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.887017 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.887195 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.887320 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.887505 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.887633 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.887820 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.887952 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.888130 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.888254 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.888441 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.888568 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.888816 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.888950 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.889073 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.889268 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.889394 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.889517 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.889714 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.889842 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.890021 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.890155 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.890332 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.890458 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.890645 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.890773 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.890959 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.891091 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.891273 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.891401 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.891591 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.891718 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.891903 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.892032 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.892215 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.892376 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.892531 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.892675 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.892862 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.892996 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.893119 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 20 04:43:26.893242 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.893501 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.893813 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.894139 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.894464 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.894806 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.895121 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.895466 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.896061 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.896380 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.896724 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.897034 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:43:26.897278 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 20 04:43:27.047054 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: INFO dbcounter [None req-46e6f4e5-96a3-486c-9716-e812d4d27d54 None None] Registered counter for database nova_api Sep 20 04:43:27.058910 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: INFO dbcounter [None req-bf77ef84-6b5f-42ee-a592-3285fbe8e95b None None] Registered counter for database nova_api Sep 20 04:43:27.067830 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG oslo_db.sqlalchemy.engines [None req-46e6f4e5-96a3-486c-9716-e812d4d27d54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111810) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 20 04:43:27.074389 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG dbcounter [-] [111810] Writer thread running {{(pid=111810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 20 04:43:27.081479 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG oslo_db.sqlalchemy.engines [None req-bf77ef84-6b5f-42ee-a592-3285fbe8e95b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111811) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 20 04:43:27.088132 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG dbcounter [-] [111811] Writer thread running {{(pid=111811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 20 04:43:27.131662 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.context [None req-46e6f4e5-96a3-486c-9716-e812d4d27d54 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),83c9afcc-a13c-497b-8ad2-720b11fbf77b(cell1) {{(pid=111810) load_cells /opt/stack/nova/nova/context.py:464}} Sep 20 04:43:27.135550 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG oslo_concurrency.lockutils [None req-46e6f4e5-96a3-486c-9716-e812d4d27d54 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:43:27.136018 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG oslo_concurrency.lockutils [None req-46e6f4e5-96a3-486c-9716-e812d4d27d54 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:43:27.137612 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG oslo_concurrency.lockutils [None req-46e6f4e5-96a3-486c-9716-e812d4d27d54 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:43:27.138364 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG oslo_concurrency.lockutils [None req-46e6f4e5-96a3-486c-9716-e812d4d27d54 None None] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:43:27.138803 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG oslo_concurrency.lockutils [None req-46e6f4e5-96a3-486c-9716-e812d4d27d54 None None] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:43:27.140797 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG oslo_concurrency.lockutils [None req-46e6f4e5-96a3-486c-9716-e812d4d27d54 None None] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:43:27.142786 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: INFO dbcounter [None req-46e6f4e5-96a3-486c-9716-e812d4d27d54 None None] Registered counter for database nova_cell0 Sep 20 04:43:27.147120 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: INFO dbcounter [None req-46e6f4e5-96a3-486c-9716-e812d4d27d54 None None] Registered counter for database nova_cell1 Sep 20 04:43:27.152950 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.context [None req-bf77ef84-6b5f-42ee-a592-3285fbe8e95b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),83c9afcc-a13c-497b-8ad2-720b11fbf77b(cell1) {{(pid=111811) load_cells /opt/stack/nova/nova/context.py:464}} Sep 20 04:43:27.156671 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG oslo_concurrency.lockutils [None req-bf77ef84-6b5f-42ee-a592-3285fbe8e95b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:43:27.156783 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG oslo_db.sqlalchemy.engines [None req-46e6f4e5-96a3-486c-9716-e812d4d27d54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111810) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 20 04:43:27.157402 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG oslo_concurrency.lockutils [None req-bf77ef84-6b5f-42ee-a592-3285fbe8e95b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:43:27.157541 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG oslo_db.sqlalchemy.engines [None req-46e6f4e5-96a3-486c-9716-e812d4d27d54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111810) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 20 04:43:27.159635 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG oslo_concurrency.lockutils [None req-bf77ef84-6b5f-42ee-a592-3285fbe8e95b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:43:27.160397 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG oslo_concurrency.lockutils [None req-bf77ef84-6b5f-42ee-a592-3285fbe8e95b None None] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:43:27.160873 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG oslo_concurrency.lockutils [None req-bf77ef84-6b5f-42ee-a592-3285fbe8e95b None None] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:43:27.164894 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG oslo_concurrency.lockutils [None req-bf77ef84-6b5f-42ee-a592-3285fbe8e95b None None] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=111811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:43:27.165181 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG dbcounter [-] [111810] Writer thread running {{(pid=111810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 20 04:43:27.166637 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG dbcounter [-] [111810] Writer thread running {{(pid=111810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 20 04:43:27.166921 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: INFO dbcounter [None req-bf77ef84-6b5f-42ee-a592-3285fbe8e95b None None] Registered counter for database nova_cell0 Sep 20 04:43:27.171006 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: INFO dbcounter [None req-bf77ef84-6b5f-42ee-a592-3285fbe8e95b None None] Registered counter for database nova_cell1 Sep 20 04:43:27.178034 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG oslo_db.sqlalchemy.engines [None req-bf77ef84-6b5f-42ee-a592-3285fbe8e95b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111811) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 20 04:43:27.182518 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG oslo_db.sqlalchemy.engines [None req-bf77ef84-6b5f-42ee-a592-3285fbe8e95b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111811) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 20 04:43:27.187029 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG dbcounter [-] [111811] Writer thread running {{(pid=111811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 20 04:43:27.312444 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: INFO dbcounter [None req-46e6f4e5-96a3-486c-9716-e812d4d27d54 None None] Registered counter for database nova_cell0 Sep 20 04:43:27.321205 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG oslo_db.sqlalchemy.engines [None req-46e6f4e5-96a3-486c-9716-e812d4d27d54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111810) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 20 04:43:27.325960 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG dbcounter [-] [111810] Writer thread running {{(pid=111810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 20 04:43:27.340090 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG dbcounter [-] [111811] Writer thread running {{(pid=111811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 20 04:43:27.350662 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: INFO dbcounter [None req-bf77ef84-6b5f-42ee-a592-3285fbe8e95b None None] Registered counter for database nova_cell0 Sep 20 04:43:27.358352 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG oslo_db.sqlalchemy.engines [None req-bf77ef84-6b5f-42ee-a592-3285fbe8e95b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111811) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 20 04:43:27.364121 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG dbcounter [-] [111811] Writer thread running {{(pid=111811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 20 04:43:27.666325 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: WARNING keystonemiddleware.auth_token [None req-46e6f4e5-96a3-486c-9716-e812d4d27d54 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 20 04:43:27.673606 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: WARNING keystonemiddleware.auth_token [None req-46e6f4e5-96a3-486c-9716-e812d4d27d54 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 20 04:43:27.684883 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: WARNING keystonemiddleware.auth_token [None req-bf77ef84-6b5f-42ee-a592-3285fbe8e95b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 20 04:43:27.692522 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: WARNING keystonemiddleware.auth_token [None req-bf77ef84-6b5f-42ee-a592-3285fbe8e95b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 20 04:43:28.016616 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: WARNING keystonemiddleware.auth_token [None req-46e6f4e5-96a3-486c-9716-e812d4d27d54 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 20 04:43:28.022816 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: WARNING keystonemiddleware.auth_token [None req-46e6f4e5-96a3-486c-9716-e812d4d27d54 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 20 04:43:28.028646 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5584732ea9c0 pid: 111810 (default app) Sep 20 04:43:28.030697 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi [None req-46e6f4e5-96a3-486c-9716-e812d4d27d54 None None] Calling method '>' {{(pid=111810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:43:28.031865 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: INFO nova.api.openstack.requestlog [None req-46e6f4e5-96a3-486c-9716-e812d4d27d54 None None] 10.222.0.27 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001711 Sep 20 04:43:28.032270 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: [pid: 111810|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 788 bytes} [Tue Sep 20 04:43:28 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:43:28.033544 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: WARNING keystonemiddleware.auth_token [None req-bf77ef84-6b5f-42ee-a592-3285fbe8e95b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 20 04:43:28.040082 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: WARNING keystonemiddleware.auth_token [None req-bf77ef84-6b5f-42ee-a592-3285fbe8e95b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 20 04:43:28.045288 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5584732ea9c0 pid: 111811 (default app) Sep 20 04:44:49.168718 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi [None req-46e6f4e5-96a3-486c-9716-e812d4d27d54 None None] Calling method '>' {{(pid=111810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:44:49.170323 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: INFO nova.api.openstack.requestlog [None req-46e6f4e5-96a3-486c-9716-e812d4d27d54 None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002088 Sep 20 04:44:49.170934 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: [pid: 111810|app: 0|req: 2/2] 10.222.0.27 () {54 vars in 931 bytes} [Tue Sep 20 04:44:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:44:49.183497 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG dbcounter [-] [111811] Writing DB stats nova_api:SELECT=3 {{(pid=111811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:44:49.184654 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG dbcounter [-] [111811] Writing DB stats nova_cell0:SELECT=3 {{(pid=111811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:44:49.185504 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG dbcounter [-] [111811] Writing DB stats nova_cell1:SELECT=3 {{(pid=111811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:44:49.186347 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG dbcounter [-] [111811] Writing DB stats nova_cell0:SELECT=3 {{(pid=111811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:44:50.038895 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi [None req-44778ee2-2875-4f23-a79c-b4c125e62312 admin admin] Calling method '>' {{(pid=111811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:44:50.071838 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: INFO nova.api.openstack.requestlog [None req-44778ee2-2875-4f23-a79c-b4c125e62312 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.893728 Sep 20 04:44:50.072558 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: [pid: 111811|app: 0|req: 1/3] 10.222.0.27 () {60 vars in 1292 bytes} [Tue Sep 20 04:44:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:44:52.677139 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi [None req-46e6f4e5-96a3-486c-9716-e812d4d27d54 None None] Calling method '>' {{(pid=111810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:44:52.678153 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: INFO nova.api.openstack.requestlog [None req-46e6f4e5-96a3-486c-9716-e812d4d27d54 None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Sep 20 04:44:52.678696 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: [pid: 111810|app: 0|req: 3/4] 10.222.0.27 () {54 vars in 931 bytes} [Tue Sep 20 04:44:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:44:53.156122 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi [None req-93c4953f-a929-4d25-a4e0-14e40787b965 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 256, "rxtx_factor": 1.0, "name": "cirros256", "disk": 1, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1}} {{(pid=111811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:44:53.203941 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: INFO nova.api.openstack.requestlog [None req-93c4953f-a929-4d25-a4e0-14e40787b965 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.519010 Sep 20 04:44:53.204422 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: [pid: 111811|app: 0|req: 2/5] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Sep 20 04:44:52 2022] POST /compute/v2.1/flavors => generated 407 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 20 04:44:53.218611 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG dbcounter [-] [111810] Writing DB stats nova_api:SELECT=3 {{(pid=111810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:44:53.219450 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG dbcounter [-] [111810] Writing DB stats nova_cell0:SELECT=3 {{(pid=111810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:44:53.221452 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG dbcounter [-] [111810] Writing DB stats nova_cell1:SELECT=3 {{(pid=111810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:44:53.223026 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG dbcounter [-] [111810] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=111810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:44:53.427069 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi [None req-507bb112-30c5-450d-bdc0-992fac97659d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:44:53.495775 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: INFO nova.api.openstack.requestlog [None req-507bb112-30c5-450d-bdc0-992fac97659d admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.282168 Sep 20 04:44:53.496379 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: [pid: 111810|app: 0|req: 4/6] 10.222.0.27 () {64 vars in 1336 bytes} [Tue Sep 20 04:44:53 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:44:56.162847 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi [None req-93c4953f-a929-4d25-a4e0-14e40787b965 admin admin] Calling method '>' {{(pid=111811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:44:56.163857 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: INFO nova.api.openstack.requestlog [None req-93c4953f-a929-4d25-a4e0-14e40787b965 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Sep 20 04:44:56.164246 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: [pid: 111811|app: 0|req: 3/7] 10.222.0.27 () {54 vars in 931 bytes} [Tue Sep 20 04:44:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:44:56.792275 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi [None req-f2159f41-e258-4d54-96e6-9ba53d590f14 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "vcpus": 1, "swap": 0, "disk": 5, "ram": 512, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d1"}} {{(pid=111810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:44:56.836283 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: INFO nova.api.openstack.requestlog [None req-f2159f41-e258-4d54-96e6-9ba53d590f14 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.665611 Sep 20 04:44:56.837231 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: [pid: 111810|app: 0|req: 5/8] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Sep 20 04:44:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 20 04:44:56.849949 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi [None req-7d13b063-8e89-4b45-b534-83f9b19734f2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:44:56.890810 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: INFO nova.api.openstack.requestlog [None req-7d13b063-8e89-4b45-b534-83f9b19734f2 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045324 Sep 20 04:44:56.891388 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: [pid: 111811|app: 0|req: 4/9] 10.222.0.27 () {64 vars in 1336 bytes} [Tue Sep 20 04:44:56 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:44:59.498770 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi [None req-f2159f41-e258-4d54-96e6-9ba53d590f14 admin admin] Calling method '>' {{(pid=111810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:44:59.499776 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: INFO nova.api.openstack.requestlog [None req-f2159f41-e258-4d54-96e6-9ba53d590f14 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Sep 20 04:44:59.500181 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: [pid: 111810|app: 0|req: 6/10] 10.222.0.27 () {54 vars in 931 bytes} [Tue Sep 20 04:44:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:44:59.930157 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi [None req-c0a82276-557f-4216-8476-3e543b24572d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "vcpus": 1, "rxtx_factor": 1.0, "ram": 1024, "id": "d2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds1G"}} {{(pid=111811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:44:59.948947 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: INFO nova.api.openstack.requestlog [None req-c0a82276-557f-4216-8476-3e543b24572d admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.442701 Sep 20 04:44:59.949480 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: [pid: 111811|app: 0|req: 5/11] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Sep 20 04:44:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 20 04:44:59.962269 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi [None req-e7f00f55-bcc0-4a43-a8f4-a343b4fd71bb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:44:59.991453 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: INFO nova.api.openstack.requestlog [None req-e7f00f55-bcc0-4a43-a8f4-a343b4fd71bb admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032716 Sep 20 04:44:59.992058 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: [pid: 111810|app: 0|req: 7/12] 10.222.0.27 () {64 vars in 1336 bytes} [Tue Sep 20 04:44:59 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:45:02.603235 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi [None req-c0a82276-557f-4216-8476-3e543b24572d admin admin] Calling method '>' {{(pid=111811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:45:02.604246 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: INFO nova.api.openstack.requestlog [None req-c0a82276-557f-4216-8476-3e543b24572d admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Sep 20 04:45:02.604656 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: [pid: 111811|app: 0|req: 6/13] 10.222.0.27 () {54 vars in 931 bytes} [Tue Sep 20 04:45:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:45:03.024461 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi [None req-cb98bfd7-7814-4e13-ab79-4dffbd46e46f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 2, "disk": 10, "rxtx_factor": 1.0, "id": "d3"}} {{(pid=111810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:45:03.043761 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: INFO nova.api.openstack.requestlog [None req-cb98bfd7-7814-4e13-ab79-4dffbd46e46f admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.432852 Sep 20 04:45:03.044674 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: [pid: 111810|app: 0|req: 8/14] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Sep 20 04:45:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 20 04:45:03.058075 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi [None req-b62aa0a8-e92c-4876-8c42-9919b5f81480 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:45:03.084148 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: INFO nova.api.openstack.requestlog [None req-b62aa0a8-e92c-4876-8c42-9919b5f81480 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030165 Sep 20 04:45:03.085004 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: [pid: 111811|app: 0|req: 7/15] 10.222.0.27 () {64 vars in 1336 bytes} [Tue Sep 20 04:45:03 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:45:05.677748 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi [None req-cb98bfd7-7814-4e13-ab79-4dffbd46e46f admin admin] Calling method '>' {{(pid=111810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:45:05.678679 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: INFO nova.api.openstack.requestlog [None req-cb98bfd7-7814-4e13-ab79-4dffbd46e46f admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001563 Sep 20 04:45:05.679076 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: [pid: 111810|app: 0|req: 9/16] 10.222.0.27 () {54 vars in 931 bytes} [Tue Sep 20 04:45:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:45:06.097025 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi [None req-4df05b75-59b7-4314-b0dd-be5ba6bfb265 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 20, "id": "d4", "os-flavor-access:is_public": true, "swap": 0, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "ram": 4096}} {{(pid=111811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:45:06.115890 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: INFO nova.api.openstack.requestlog [None req-4df05b75-59b7-4314-b0dd-be5ba6bfb265 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.430602 Sep 20 04:45:06.116447 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: [pid: 111811|app: 0|req: 8/17] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Sep 20 04:45:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 20 04:45:06.132230 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi [None req-27d16084-922f-4768-888d-37eb4ada09ee admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:45:06.163615 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: INFO nova.api.openstack.requestlog [None req-27d16084-922f-4768-888d-37eb4ada09ee admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036958 Sep 20 04:45:06.164721 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: [pid: 111810|app: 0|req: 10/18] 10.222.0.27 () {64 vars in 1336 bytes} [Tue Sep 20 04:45:06 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:45:09.153436 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi [None req-4df05b75-59b7-4314-b0dd-be5ba6bfb265 admin admin] Calling method '>' {{(pid=111811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:45:09.154742 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: INFO nova.api.openstack.requestlog [None req-4df05b75-59b7-4314-b0dd-be5ba6bfb265 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001944 Sep 20 04:45:09.155250 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: [pid: 111811|app: 0|req: 9/19] 10.222.0.27 () {54 vars in 931 bytes} [Tue Sep 20 04:45:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:45:09.633040 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi [None req-f78b2ad9-2e4a-40cf-bad1-512d27270c36 admin admin] Calling method '>' {{(pid=111810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:45:09.656991 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: INFO nova.api.openstack.requestlog [None req-f78b2ad9-2e4a-40cf-bad1-512d27270c36 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.494158 Sep 20 04:45:09.658006 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: [pid: 111810|app: 0|req: 11/20] 10.222.0.27 () {60 vars in 1292 bytes} [Tue Sep 20 04:45:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 04:45:12.645289 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi [None req-4df05b75-59b7-4314-b0dd-be5ba6bfb265 admin admin] Calling method '>' {{(pid=111811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:45:12.646303 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: INFO nova.api.openstack.requestlog [None req-4df05b75-59b7-4314-b0dd-be5ba6bfb265 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Sep 20 04:45:12.646708 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: [pid: 111811|app: 0|req: 10/21] 10.222.0.27 () {54 vars in 931 bytes} [Tue Sep 20 04:45:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:45:13.044745 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi [None req-aaa7695a-f4ae-418f-8b6f-242e9c6e8fa4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "1", "disk": 1, "name": "m1.tiny", "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=111810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:45:13.063855 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: INFO nova.api.openstack.requestlog [None req-aaa7695a-f4ae-418f-8b6f-242e9c6e8fa4 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.411176 Sep 20 04:45:13.064409 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: [pid: 111810|app: 0|req: 12/22] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Sep 20 04:45:12 2022] POST /compute/v2.1/flavors => generated 402 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 20 04:45:13.076267 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi [None req-5b616146-709d-470f-8b73-589d730ab443 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:45:13.103965 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: INFO nova.api.openstack.requestlog [None req-5b616146-709d-470f-8b73-589d730ab443 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031255 Sep 20 04:45:13.104550 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: [pid: 111811|app: 0|req: 11/23] 10.222.0.27 () {64 vars in 1333 bytes} [Tue Sep 20 04:45:13 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:45:15.718598 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi [None req-aaa7695a-f4ae-418f-8b6f-242e9c6e8fa4 admin admin] Calling method '>' {{(pid=111810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:45:15.719675 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: INFO nova.api.openstack.requestlog [None req-aaa7695a-f4ae-418f-8b6f-242e9c6e8fa4 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Sep 20 04:45:15.720129 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: [pid: 111810|app: 0|req: 13/24] 10.222.0.27 () {54 vars in 931 bytes} [Tue Sep 20 04:45:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 04:45:16.136929 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi [None req-c9e3dbc9-839c-4bae-9ca9-f1489b917950 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "vcpus": 1, "disk": 20, "name": "m1.small", "id": "2", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:45:16.163060 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: INFO nova.api.openstack.requestlog [None req-c9e3dbc9-839c-4bae-9ca9-f1489b917950 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.436785 Sep 20 04:45:16.163613 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: [pid: 111811|app: 0|req: 12/25] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Sep 20 04:45:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 20 04:45:16.176189 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi [None req-a7fc74ea-5db6-4c42-8e1c-a804931641df admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:45:16.200174 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: INFO nova.api.openstack.requestlog [None req-a7fc74ea-5db6-4c42-8e1c-a804931641df admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028178 Sep 20 04:45:16.200777 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: [pid: 111810|app: 0|req: 14/26] 10.222.0.27 () {64 vars in 1333 bytes} [Tue Sep 20 04:45:16 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:45:18.836176 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi [None req-c9e3dbc9-839c-4bae-9ca9-f1489b917950 admin admin] Calling method '>' {{(pid=111811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:45:18.837464 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: INFO nova.api.openstack.requestlog [None req-c9e3dbc9-839c-4bae-9ca9-f1489b917950 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001733 Sep 20 04:45:18.838065 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: [pid: 111811|app: 0|req: 13/27] 10.222.0.27 () {54 vars in 931 bytes} [Tue Sep 20 04:45:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:45:19.286482 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi [None req-5a2cdee0-52d1-4f78-ade5-946afb86585f admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "swap": 0, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.medium", "os-flavor-access:is_public": true, "ram": 4096, "vcpus": 2}} {{(pid=111810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:45:19.308849 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: INFO nova.api.openstack.requestlog [None req-5a2cdee0-52d1-4f78-ade5-946afb86585f admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.464417 Sep 20 04:45:19.309665 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: [pid: 111810|app: 0|req: 15/28] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Sep 20 04:45:18 2022] POST /compute/v2.1/flavors => generated 406 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 20 04:45:19.321923 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi [None req-586d9bbf-0848-41ad-8eb2-8f746bc91376 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:45:19.328439 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG dbcounter [-] [111811] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=111811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:45:19.378879 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: INFO nova.api.openstack.requestlog [None req-586d9bbf-0848-41ad-8eb2-8f746bc91376 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.060576 Sep 20 04:45:19.392637 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: [pid: 111811|app: 0|req: 14/29] 10.222.0.27 () {64 vars in 1333 bytes} [Tue Sep 20 04:45:19 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:45:22.040799 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi [None req-5a2cdee0-52d1-4f78-ade5-946afb86585f admin admin] Calling method '>' {{(pid=111810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:45:22.042337 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: INFO nova.api.openstack.requestlog [None req-5a2cdee0-52d1-4f78-ade5-946afb86585f admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002184 Sep 20 04:45:22.042928 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: [pid: 111810|app: 0|req: 16/30] 10.222.0.27 () {54 vars in 931 bytes} [Tue Sep 20 04:45:22 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:45:22.484170 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi [None req-cce001a5-f259-4042-a72c-cd5b643c39d5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 8192, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.large", "id": "4", "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4}} {{(pid=111811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:45:22.508128 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: INFO nova.api.openstack.requestlog [None req-cce001a5-f259-4042-a72c-cd5b643c39d5 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.456647 Sep 20 04:45:22.509036 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: [pid: 111811|app: 0|req: 15/31] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Sep 20 04:45:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 20 04:45:22.521796 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi [None req-c118f0ac-1971-4328-bee0-2dd0c49e95f9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:45:22.545338 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: INFO nova.api.openstack.requestlog [None req-c118f0ac-1971-4328-bee0-2dd0c49e95f9 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027326 Sep 20 04:45:22.546183 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: [pid: 111810|app: 0|req: 17/32] 10.222.0.27 () {64 vars in 1333 bytes} [Tue Sep 20 04:45:22 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:45:25.196933 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi [None req-cce001a5-f259-4042-a72c-cd5b643c39d5 admin admin] Calling method '>' {{(pid=111811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:45:25.198679 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: INFO nova.api.openstack.requestlog [None req-cce001a5-f259-4042-a72c-cd5b643c39d5 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002261 Sep 20 04:45:25.199416 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: [pid: 111811|app: 0|req: 16/33] 10.222.0.27 () {54 vars in 931 bytes} [Tue Sep 20 04:45:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:45:25.630264 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi [None req-c9cd0c99-84e7-41e1-872a-052a0f383e13 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 8, "ram": 16384, "id": "5", "swap": 0, "rxtx_factor": 1.0, "disk": 160}} {{(pid=111810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:45:25.637572 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG dbcounter [-] [111810] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=111810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:45:25.652932 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: INFO nova.api.openstack.requestlog [None req-c9cd0c99-84e7-41e1-872a-052a0f383e13 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.447014 Sep 20 04:45:25.653835 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: [pid: 111810|app: 0|req: 18/34] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Sep 20 04:45:25 2022] POST /compute/v2.1/flavors => generated 408 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 20 04:45:25.665935 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi [None req-5e23d533-93c6-49f8-8e17-21568174c418 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:45:25.695990 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: INFO nova.api.openstack.requestlog [None req-5e23d533-93c6-49f8-8e17-21568174c418 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033568 Sep 20 04:45:25.701178 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: [pid: 111811|app: 0|req: 17/35] 10.222.0.27 () {64 vars in 1333 bytes} [Tue Sep 20 04:45:25 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:45:42.588337 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi [None req-c9cd0c99-84e7-41e1-872a-052a0f383e13 admin admin] Calling method '>' {{(pid=111810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:45:42.589383 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: INFO nova.api.openstack.requestlog [None req-c9cd0c99-84e7-41e1-872a-052a0f383e13 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Sep 20 04:45:42.589786 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: [pid: 111810|app: 0|req: 19/36] 10.222.0.27 () {54 vars in 931 bytes} [Tue Sep 20 04:45:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:45:42.600422 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG dbcounter [-] [111811] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=111811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:45:43.093618 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi [None req-59d1a780-b756-4606-a494-60b97c7d336d admin admin] Calling method '>' {{(pid=111811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:45:43.112751 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: INFO nova.api.openstack.requestlog [None req-59d1a780-b756-4606-a494-60b97c7d336d admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.516714 Sep 20 04:45:43.113283 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: [pid: 111811|app: 0|req: 18/37] 10.222.0.27 () {60 vars in 1292 bytes} [Tue Sep 20 04:45:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 04:45:44.409450 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi [None req-c9cd0c99-84e7-41e1-872a-052a0f383e13 admin admin] Calling method '>' {{(pid=111810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:45:44.410393 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: INFO nova.api.openstack.requestlog [None req-c9cd0c99-84e7-41e1-872a-052a0f383e13 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002054 Sep 20 04:45:44.410790 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: [pid: 111810|app: 0|req: 20/38] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Sep 20 04:45:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:45:44.939882 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi [None req-2bb562d8-0810-410e-be9c-c4cfffd5937b admin admin] Calling method '>' {{(pid=111811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:45:44.945075 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: INFO nova.api.openstack.wsgi [None req-2bb562d8-0810-410e-be9c-c4cfffd5937b admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 20 04:45:44.948266 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi [None req-2bb562d8-0810-410e-be9c-c4cfffd5937b admin admin] Request method failure captured: Sep 20 04:45:44.948266 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 20 04:45:44.948266 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: Accept: application/json Sep 20 04:45:44.948266 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: Accept-Encoding: gzip, deflate Sep 20 04:45:44.948266 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: Connection: keep-alive Sep 20 04:45:44.948266 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: Content-Length: 0 Sep 20 04:45:44.948266 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: Host: 10.222.0.27 Sep 20 04:45:44.948266 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: Openstack-Api-Version: compute 2.92 Sep 20 04:45:44.948266 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: Openstack-System-Scope: None Sep 20 04:45:44.948266 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: User-Agent: python-novaclient Sep 20 04:45:44.948266 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-Auth-Token: gAAAAABjKUV4OJB49_Mgfe5XDYEpy5pmX7zf9Ej2xI8TkZKQJNUKTqJYwH6FTlmS2dR-qEtK9KTC06wk6GQ1DjXgRmlnkpbZ-l2KFk_hGUowaaqSuSsl2P9sZLtpGvUgHrunoP6PKzR_UmKKfu5bA7c_qmRoa5-u7yopU_4fQ6p4CtpCSn20wzw Sep 20 04:45:44.948266 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-Domain-Id: None Sep 20 04:45:44.948266 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-Domain-Name: None Sep 20 04:45:44.948266 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-Identity-Status: Confirmed Sep 20 04:45:44.948266 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-Is-Admin-Project: True Sep 20 04:45:44.948266 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-Openstack-Nova-Api-Version: 2.92 Sep 20 04:45:44.948266 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-Project-Domain-Id: default Sep 20 04:45:44.948266 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-Project-Domain-Name: Default Sep 20 04:45:44.948266 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-Project-Id: 612c023f1ed44b9f936be9c752c292ec Sep 20 04:45:44.948266 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-Project-Name: admin Sep 20 04:45:44.948266 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-Role: member,reader,admin Sep 20 04:45:44.948266 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-Roles: member,reader,admin Sep 20 04:45:44.949986 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/612c023f1ed44b9f936be9c752c292ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/612c023f1ed44b9f936be9c752c292ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_612c023f1ed44b9f936be9c752c292ec", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/612c023f1ed44b9f936be9c752c292ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 04:45:44.949986 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-Tenant: admin Sep 20 04:45:44.949986 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-Tenant-Id: 612c023f1ed44b9f936be9c752c292ec Sep 20 04:45:44.949986 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-Tenant-Name: admin Sep 20 04:45:44.949986 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-User: admin Sep 20 04:45:44.949986 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-User-Domain-Id: default Sep 20 04:45:44.949986 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-User-Domain-Name: Default Sep 20 04:45:44.949986 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-User-Id: 095a92acb2e04f44b21db4de77e2a16a Sep 20 04:45:44.949986 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-User-Name: admin Sep 20 04:45:44.949986 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: method: > Sep 20 04:45:44.949986 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: exception: Flavor 42 could not be found. Sep 20 04:45:44.949986 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: action_args: {'id': '42'} Sep 20 04:45:44.949986 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: {{(pid=111811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 04:45:44.949986 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:45:44.951157 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 20 04:45:44.951157 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 20 04:45:44.951157 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 20 04:45:44.951157 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 20 04:45:44.951157 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 20 04:45:44.951157 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 20 04:45:44.951157 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 20 04:45:44.951157 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 20 04:45:44.951157 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 20 04:45:44.951157 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 04:45:44.951157 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 20 04:45:44.951157 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 20 04:45:44.951157 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 20 04:45:44.951157 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi Sep 20 04:45:44.951157 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:45:44.951157 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi Sep 20 04:45:44.951157 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:45:44.951157 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:45:44.951157 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:45:44.952555 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 04:45:44.952555 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 04:45:44.952555 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 04:45:44.952555 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 04:45:44.952555 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 20 04:45:44.952555 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 20 04:45:44.952555 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 20 04:45:44.952555 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi Sep 20 04:45:44.952555 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:45:44.952555 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi Sep 20 04:45:44.952555 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:45:44.952555 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:45:44.952555 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:45:44.952555 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 04:45:44.952555 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 04:45:44.952555 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 20 04:45:44.952555 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi Sep 20 04:45:44.952555 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi [None req-2bb562d8-0810-410e-be9c-c4cfffd5937b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=111811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 04:45:44.953996 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: INFO nova.api.openstack.requestlog [None req-2bb562d8-0810-410e-be9c-c4cfffd5937b admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.391717 Sep 20 04:45:44.953996 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: [pid: 111811|app: 0|req: 19/39] 10.222.0.27 () {60 vars in 1190 bytes} [Tue Sep 20 04:45:44 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 20 04:45:44.959732 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi [None req-48f95bcf-9b8a-45ff-b084-2ef8aa90d5d2 admin admin] Calling method '>' {{(pid=111810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:45:44.981511 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: INFO nova.api.openstack.requestlog [None req-48f95bcf-9b8a-45ff-b084-2ef8aa90d5d2 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.025606 Sep 20 04:45:44.981986 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: [pid: 111810|app: 0|req: 21/40] 10.222.0.27 () {60 vars in 1210 bytes} [Tue Sep 20 04:45:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 04:45:44.992893 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi [None req-b461b6c7-3694-4f02-93d0-cef2ca77dcee admin admin] Calling method '>' {{(pid=111811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:45:45.015035 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: INFO nova.api.openstack.requestlog [None req-b461b6c7-3694-4f02-93d0-cef2ca77dcee admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026577 Sep 20 04:45:45.015566 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: [pid: 111811|app: 0|req: 20/41] 10.222.0.27 () {60 vars in 1210 bytes} [Tue Sep 20 04:45:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 04:45:45.024794 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi [None req-34cd333b-6fb4-4e4f-b0db-129c441cc04d admin admin] Calling method '>' {{(pid=111810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:45:45.029960 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: INFO nova.api.openstack.wsgi [None req-34cd333b-6fb4-4e4f-b0db-129c441cc04d admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 20 04:45:45.033521 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi [None req-34cd333b-6fb4-4e4f-b0db-129c441cc04d admin admin] Request method failure captured: Sep 20 04:45:45.033521 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 20 04:45:45.033521 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: Accept: application/json Sep 20 04:45:45.033521 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: Accept-Encoding: gzip, deflate Sep 20 04:45:45.033521 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: Connection: keep-alive Sep 20 04:45:45.033521 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: Content-Length: 0 Sep 20 04:45:45.033521 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: Host: 10.222.0.27 Sep 20 04:45:45.033521 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: Openstack-Api-Version: compute 2.92 Sep 20 04:45:45.033521 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: Openstack-System-Scope: None Sep 20 04:45:45.033521 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: User-Agent: python-novaclient Sep 20 04:45:45.033521 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-Auth-Token: gAAAAABjKUV4OJB49_Mgfe5XDYEpy5pmX7zf9Ej2xI8TkZKQJNUKTqJYwH6FTlmS2dR-qEtK9KTC06wk6GQ1DjXgRmlnkpbZ-l2KFk_hGUowaaqSuSsl2P9sZLtpGvUgHrunoP6PKzR_UmKKfu5bA7c_qmRoa5-u7yopU_4fQ6p4CtpCSn20wzw Sep 20 04:45:45.033521 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-Domain-Id: None Sep 20 04:45:45.033521 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-Domain-Name: None Sep 20 04:45:45.033521 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-Identity-Status: Confirmed Sep 20 04:45:45.033521 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-Is-Admin-Project: True Sep 20 04:45:45.033521 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-Openstack-Nova-Api-Version: 2.92 Sep 20 04:45:45.033521 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-Project-Domain-Id: default Sep 20 04:45:45.033521 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-Project-Domain-Name: Default Sep 20 04:45:45.033521 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-Project-Id: 612c023f1ed44b9f936be9c752c292ec Sep 20 04:45:45.033521 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-Project-Name: admin Sep 20 04:45:45.033521 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-Role: member,reader,admin Sep 20 04:45:45.033521 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-Roles: member,reader,admin Sep 20 04:45:45.035741 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/612c023f1ed44b9f936be9c752c292ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/612c023f1ed44b9f936be9c752c292ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_612c023f1ed44b9f936be9c752c292ec", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/612c023f1ed44b9f936be9c752c292ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 04:45:45.035741 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-Tenant: admin Sep 20 04:45:45.035741 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-Tenant-Id: 612c023f1ed44b9f936be9c752c292ec Sep 20 04:45:45.035741 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-Tenant-Name: admin Sep 20 04:45:45.035741 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-User: admin Sep 20 04:45:45.035741 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-User-Domain-Id: default Sep 20 04:45:45.035741 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-User-Domain-Name: Default Sep 20 04:45:45.035741 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-User-Id: 095a92acb2e04f44b21db4de77e2a16a Sep 20 04:45:45.035741 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-User-Name: admin Sep 20 04:45:45.035741 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: method: > Sep 20 04:45:45.035741 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: exception: Flavor 42 could not be found. Sep 20 04:45:45.035741 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: action_args: {'id': '42'} Sep 20 04:45:45.035741 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: {{(pid=111810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 04:45:45.035741 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:45:45.036758 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 20 04:45:45.036758 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 20 04:45:45.036758 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 20 04:45:45.036758 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 20 04:45:45.036758 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 20 04:45:45.036758 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 20 04:45:45.036758 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 20 04:45:45.036758 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 20 04:45:45.036758 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 20 04:45:45.036758 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 04:45:45.036758 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 20 04:45:45.036758 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 20 04:45:45.036758 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 20 04:45:45.036758 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi Sep 20 04:45:45.036758 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:45:45.036758 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi Sep 20 04:45:45.036758 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:45:45.036758 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:45:45.036758 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:45:45.038048 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 04:45:45.038048 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 04:45:45.038048 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 04:45:45.038048 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 04:45:45.038048 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 20 04:45:45.038048 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 20 04:45:45.038048 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 20 04:45:45.038048 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi Sep 20 04:45:45.038048 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:45:45.038048 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi Sep 20 04:45:45.038048 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:45:45.038048 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:45:45.038048 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:45:45.038048 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 04:45:45.038048 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 04:45:45.038048 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 20 04:45:45.038048 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi Sep 20 04:45:45.038048 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi [None req-34cd333b-6fb4-4e4f-b0db-129c441cc04d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=111810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 04:45:45.039295 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: INFO nova.api.openstack.requestlog [None req-34cd333b-6fb4-4e4f-b0db-129c441cc04d admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013551 Sep 20 04:45:45.039295 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: [pid: 111810|app: 0|req: 22/42] 10.222.0.27 () {60 vars in 1190 bytes} [Tue Sep 20 04:45:45 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 20 04:45:46.247381 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi [None req-b461b6c7-3694-4f02-93d0-cef2ca77dcee admin admin] Calling method '>' {{(pid=111811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:45:46.248385 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: INFO nova.api.openstack.requestlog [None req-b461b6c7-3694-4f02-93d0-cef2ca77dcee admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Sep 20 04:45:46.248814 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: [pid: 111811|app: 0|req: 21/43] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Sep 20 04:45:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:45:46.763678 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi [None req-bba83169-eab3-4364-9e27-1c3ada8d1798 admin admin] Calling method '>' {{(pid=111810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:45:46.768776 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: INFO nova.api.openstack.wsgi [None req-bba83169-eab3-4364-9e27-1c3ada8d1798 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 20 04:45:46.770512 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi [None req-bba83169-eab3-4364-9e27-1c3ada8d1798 admin admin] Request method failure captured: Sep 20 04:45:46.770512 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 20 04:45:46.770512 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: Accept: application/json Sep 20 04:45:46.770512 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: Accept-Encoding: gzip, deflate Sep 20 04:45:46.770512 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: Connection: keep-alive Sep 20 04:45:46.770512 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: Content-Length: 0 Sep 20 04:45:46.770512 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: Host: 10.222.0.27 Sep 20 04:45:46.770512 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: Openstack-Api-Version: compute 2.92 Sep 20 04:45:46.770512 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: Openstack-System-Scope: None Sep 20 04:45:46.770512 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: User-Agent: python-novaclient Sep 20 04:45:46.770512 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-Auth-Token: gAAAAABjKUV6IZB9eAt0IhggNxqnO99KYpKFcEHH_v5iT82TdmSRE10qUL-vG5LPhd_4e16lLrj0tdd1HPjfvLIRg7UDnScSCE1GRAKu3djNNpPj0HRQzy4L5o82yUcskTxnK4nPKiREvQpmpcdYQroWYKlYZTKrmYMls5hl-qdpioka96V988U Sep 20 04:45:46.770512 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-Domain-Id: None Sep 20 04:45:46.770512 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-Domain-Name: None Sep 20 04:45:46.770512 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-Identity-Status: Confirmed Sep 20 04:45:46.770512 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-Is-Admin-Project: True Sep 20 04:45:46.770512 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-Openstack-Nova-Api-Version: 2.92 Sep 20 04:45:46.770512 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-Project-Domain-Id: default Sep 20 04:45:46.770512 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-Project-Domain-Name: Default Sep 20 04:45:46.770512 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-Project-Id: 612c023f1ed44b9f936be9c752c292ec Sep 20 04:45:46.770512 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-Project-Name: admin Sep 20 04:45:46.770512 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-Role: member,reader,admin Sep 20 04:45:46.770512 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-Roles: member,reader,admin Sep 20 04:45:46.772040 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/612c023f1ed44b9f936be9c752c292ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/612c023f1ed44b9f936be9c752c292ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_612c023f1ed44b9f936be9c752c292ec", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/612c023f1ed44b9f936be9c752c292ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 04:45:46.772040 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-Tenant: admin Sep 20 04:45:46.772040 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-Tenant-Id: 612c023f1ed44b9f936be9c752c292ec Sep 20 04:45:46.772040 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-Tenant-Name: admin Sep 20 04:45:46.772040 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-User: admin Sep 20 04:45:46.772040 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-User-Domain-Id: default Sep 20 04:45:46.772040 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-User-Domain-Name: Default Sep 20 04:45:46.772040 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-User-Id: 095a92acb2e04f44b21db4de77e2a16a Sep 20 04:45:46.772040 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-User-Name: admin Sep 20 04:45:46.772040 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: method: > Sep 20 04:45:46.772040 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: exception: Flavor 84 could not be found. Sep 20 04:45:46.772040 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: action_args: {'id': '84'} Sep 20 04:45:46.772040 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: {{(pid=111810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 04:45:46.772040 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:45:46.772994 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 20 04:45:46.772994 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 20 04:45:46.772994 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 20 04:45:46.772994 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 20 04:45:46.772994 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 20 04:45:46.772994 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 20 04:45:46.772994 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 20 04:45:46.772994 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 20 04:45:46.772994 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 20 04:45:46.772994 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 04:45:46.772994 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 20 04:45:46.772994 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 20 04:45:46.772994 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 20 04:45:46.772994 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi Sep 20 04:45:46.772994 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:45:46.772994 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi Sep 20 04:45:46.772994 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:45:46.772994 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:45:46.772994 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:45:46.774479 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 04:45:46.774479 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 04:45:46.774479 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 04:45:46.774479 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 04:45:46.774479 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 20 04:45:46.774479 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 20 04:45:46.774479 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 20 04:45:46.774479 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi Sep 20 04:45:46.774479 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:45:46.774479 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi Sep 20 04:45:46.774479 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:45:46.774479 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:45:46.774479 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:45:46.774479 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 04:45:46.774479 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 04:45:46.774479 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 20 04:45:46.774479 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi Sep 20 04:45:46.774479 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi [None req-bba83169-eab3-4364-9e27-1c3ada8d1798 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=111810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 04:45:46.775784 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: INFO nova.api.openstack.requestlog [None req-bba83169-eab3-4364-9e27-1c3ada8d1798 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.386441 Sep 20 04:45:46.775784 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: [pid: 111810|app: 0|req: 23/44] 10.222.0.27 () {60 vars in 1190 bytes} [Tue Sep 20 04:45:46 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 387 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 20 04:45:46.781514 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi [None req-2b1fe50a-8789-4827-9fe8-ff6d276d2f9d admin admin] Calling method '>' {{(pid=111811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:45:46.797295 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: INFO nova.api.openstack.requestlog [None req-2b1fe50a-8789-4827-9fe8-ff6d276d2f9d admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019355 Sep 20 04:45:46.797819 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: [pid: 111811|app: 0|req: 22/45] 10.222.0.27 () {60 vars in 1210 bytes} [Tue Sep 20 04:45:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 04:45:46.807679 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi [None req-f4e32af6-8dbf-422c-b81c-83ccfcf7931c admin admin] Calling method '>' {{(pid=111810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:45:46.824644 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: INFO nova.api.openstack.requestlog [None req-f4e32af6-8dbf-422c-b81c-83ccfcf7931c admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020489 Sep 20 04:45:46.825180 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: [pid: 111810|app: 0|req: 24/46] 10.222.0.27 () {60 vars in 1210 bytes} [Tue Sep 20 04:45:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 04:45:46.834325 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi [None req-302bff5b-ad4b-4333-9b89-6ecc349f9511 admin admin] Calling method '>' {{(pid=111811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:45:46.839298 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: INFO nova.api.openstack.wsgi [None req-302bff5b-ad4b-4333-9b89-6ecc349f9511 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 20 04:45:46.840840 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi [None req-302bff5b-ad4b-4333-9b89-6ecc349f9511 admin admin] Request method failure captured: Sep 20 04:45:46.840840 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 20 04:45:46.840840 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: Accept: application/json Sep 20 04:45:46.840840 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: Accept-Encoding: gzip, deflate Sep 20 04:45:46.840840 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: Connection: keep-alive Sep 20 04:45:46.840840 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: Content-Length: 0 Sep 20 04:45:46.840840 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: Host: 10.222.0.27 Sep 20 04:45:46.840840 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: Openstack-Api-Version: compute 2.92 Sep 20 04:45:46.840840 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: Openstack-System-Scope: None Sep 20 04:45:46.840840 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: User-Agent: python-novaclient Sep 20 04:45:46.840840 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-Auth-Token: gAAAAABjKUV6IZB9eAt0IhggNxqnO99KYpKFcEHH_v5iT82TdmSRE10qUL-vG5LPhd_4e16lLrj0tdd1HPjfvLIRg7UDnScSCE1GRAKu3djNNpPj0HRQzy4L5o82yUcskTxnK4nPKiREvQpmpcdYQroWYKlYZTKrmYMls5hl-qdpioka96V988U Sep 20 04:45:46.840840 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-Domain-Id: None Sep 20 04:45:46.840840 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-Domain-Name: None Sep 20 04:45:46.840840 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-Identity-Status: Confirmed Sep 20 04:45:46.840840 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-Is-Admin-Project: True Sep 20 04:45:46.840840 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-Openstack-Nova-Api-Version: 2.92 Sep 20 04:45:46.840840 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-Project-Domain-Id: default Sep 20 04:45:46.840840 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-Project-Domain-Name: Default Sep 20 04:45:46.840840 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-Project-Id: 612c023f1ed44b9f936be9c752c292ec Sep 20 04:45:46.840840 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-Project-Name: admin Sep 20 04:45:46.840840 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-Role: member,reader,admin Sep 20 04:45:46.840840 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-Roles: member,reader,admin Sep 20 04:45:46.842484 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/612c023f1ed44b9f936be9c752c292ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/612c023f1ed44b9f936be9c752c292ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_612c023f1ed44b9f936be9c752c292ec", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/612c023f1ed44b9f936be9c752c292ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 04:45:46.842484 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-Tenant: admin Sep 20 04:45:46.842484 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-Tenant-Id: 612c023f1ed44b9f936be9c752c292ec Sep 20 04:45:46.842484 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-Tenant-Name: admin Sep 20 04:45:46.842484 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-User: admin Sep 20 04:45:46.842484 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-User-Domain-Id: default Sep 20 04:45:46.842484 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-User-Domain-Name: Default Sep 20 04:45:46.842484 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-User-Id: 095a92acb2e04f44b21db4de77e2a16a Sep 20 04:45:46.842484 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-User-Name: admin Sep 20 04:45:46.842484 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: method: > Sep 20 04:45:46.842484 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: exception: Flavor 84 could not be found. Sep 20 04:45:46.842484 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: action_args: {'id': '84'} Sep 20 04:45:46.842484 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: {{(pid=111811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 04:45:46.842484 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:45:46.843544 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 20 04:45:46.843544 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 20 04:45:46.843544 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 20 04:45:46.843544 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 20 04:45:46.843544 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 20 04:45:46.843544 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 20 04:45:46.843544 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 20 04:45:46.843544 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 20 04:45:46.843544 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 20 04:45:46.843544 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 04:45:46.843544 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 20 04:45:46.843544 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 20 04:45:46.843544 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 20 04:45:46.843544 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi Sep 20 04:45:46.843544 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:45:46.843544 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi Sep 20 04:45:46.843544 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:45:46.843544 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:45:46.843544 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:45:46.845117 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 04:45:46.845117 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 04:45:46.845117 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 04:45:46.845117 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 04:45:46.845117 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 20 04:45:46.845117 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 20 04:45:46.845117 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 20 04:45:46.845117 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi Sep 20 04:45:46.845117 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:45:46.845117 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi Sep 20 04:45:46.845117 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:45:46.845117 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:45:46.845117 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:45:46.845117 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 04:45:46.845117 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 04:45:46.845117 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 20 04:45:46.845117 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi Sep 20 04:45:46.845117 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi [None req-302bff5b-ad4b-4333-9b89-6ecc349f9511 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=111811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 04:45:46.846974 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: INFO nova.api.openstack.requestlog [None req-302bff5b-ad4b-4333-9b89-6ecc349f9511 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011412 Sep 20 04:45:46.846974 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: [pid: 111811|app: 0|req: 23/47] 10.222.0.27 () {60 vars in 1190 bytes} [Tue Sep 20 04:45:46 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 20 04:45:48.051751 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi [None req-f4e32af6-8dbf-422c-b81c-83ccfcf7931c admin admin] Calling method '>' {{(pid=111810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:45:48.052764 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: INFO nova.api.openstack.requestlog [None req-f4e32af6-8dbf-422c-b81c-83ccfcf7931c admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Sep 20 04:45:48.053158 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: [pid: 111810|app: 0|req: 25/48] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Sep 20 04:45:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:45:48.691187 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi [None req-33331451-a582-42f3-b713-bacf6c7ed44a admin admin] Calling method '>' {{(pid=111811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:45:48.696830 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: INFO nova.api.openstack.wsgi [None req-33331451-a582-42f3-b713-bacf6c7ed44a admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 20 04:45:48.698310 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi [None req-33331451-a582-42f3-b713-bacf6c7ed44a admin admin] Request method failure captured: Sep 20 04:45:48.698310 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 20 04:45:48.698310 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: Accept: application/json Sep 20 04:45:48.698310 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: Accept-Encoding: gzip, deflate Sep 20 04:45:48.698310 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: Connection: keep-alive Sep 20 04:45:48.698310 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: Content-Length: 0 Sep 20 04:45:48.698310 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: Host: 10.222.0.27 Sep 20 04:45:48.698310 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: Openstack-Api-Version: compute 2.92 Sep 20 04:45:48.698310 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: Openstack-System-Scope: None Sep 20 04:45:48.698310 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: User-Agent: python-novaclient Sep 20 04:45:48.698310 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-Auth-Token: gAAAAABjKUV7HmkxgY9pTRPqNEW-fnhjp8NOCyi6NWMiQ9ynQu54Er0ChEYFQoSe5HG9U-O5IQ5s4RpfnJVHZyDANkmBb867jwtMHDPmq8_zT55pgB1Fli-9Hd9nGHPmuYx_eTBh8ZJx2TGilC-QIDTzZYgfzl-bqvyH0QgXpBxKYy7zJJQSMOs Sep 20 04:45:48.698310 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-Domain-Id: None Sep 20 04:45:48.698310 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-Domain-Name: None Sep 20 04:45:48.698310 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-Identity-Status: Confirmed Sep 20 04:45:48.698310 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-Is-Admin-Project: True Sep 20 04:45:48.698310 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-Openstack-Nova-Api-Version: 2.92 Sep 20 04:45:48.698310 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-Project-Domain-Id: default Sep 20 04:45:48.698310 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-Project-Domain-Name: Default Sep 20 04:45:48.698310 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-Project-Id: 612c023f1ed44b9f936be9c752c292ec Sep 20 04:45:48.698310 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-Project-Name: admin Sep 20 04:45:48.698310 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-Role: member,reader,admin Sep 20 04:45:48.698310 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-Roles: member,reader,admin Sep 20 04:45:48.699844 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/612c023f1ed44b9f936be9c752c292ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/612c023f1ed44b9f936be9c752c292ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_612c023f1ed44b9f936be9c752c292ec", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/612c023f1ed44b9f936be9c752c292ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 04:45:48.699844 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-Tenant: admin Sep 20 04:45:48.699844 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-Tenant-Id: 612c023f1ed44b9f936be9c752c292ec Sep 20 04:45:48.699844 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-Tenant-Name: admin Sep 20 04:45:48.699844 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-User: admin Sep 20 04:45:48.699844 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-User-Domain-Id: default Sep 20 04:45:48.699844 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-User-Domain-Name: Default Sep 20 04:45:48.699844 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-User-Id: 095a92acb2e04f44b21db4de77e2a16a Sep 20 04:45:48.699844 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: X-User-Name: admin Sep 20 04:45:48.699844 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: method: > Sep 20 04:45:48.699844 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: exception: Flavor 451 could not be found. Sep 20 04:45:48.699844 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: action_args: {'id': '451'} Sep 20 04:45:48.699844 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: {{(pid=111811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 04:45:48.699844 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:45:48.700835 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 20 04:45:48.700835 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 20 04:45:48.700835 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 20 04:45:48.700835 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 20 04:45:48.700835 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 20 04:45:48.700835 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 20 04:45:48.700835 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 20 04:45:48.700835 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 20 04:45:48.700835 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 20 04:45:48.700835 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 04:45:48.700835 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 20 04:45:48.700835 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 20 04:45:48.700835 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 20 04:45:48.700835 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi Sep 20 04:45:48.700835 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:45:48.700835 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi Sep 20 04:45:48.700835 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:45:48.700835 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:45:48.700835 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:45:48.701977 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 04:45:48.701977 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 04:45:48.701977 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 04:45:48.701977 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 04:45:48.701977 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 20 04:45:48.701977 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 20 04:45:48.701977 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 20 04:45:48.701977 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi Sep 20 04:45:48.701977 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:45:48.701977 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi Sep 20 04:45:48.701977 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:45:48.701977 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:45:48.701977 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:45:48.701977 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 04:45:48.701977 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 04:45:48.701977 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 20 04:45:48.701977 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: ERROR nova.api.openstack.wsgi Sep 20 04:45:48.701977 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi [None req-33331451-a582-42f3-b713-bacf6c7ed44a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=111811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 04:45:48.703016 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: INFO nova.api.openstack.requestlog [None req-33331451-a582-42f3-b713-bacf6c7ed44a admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.510705 Sep 20 04:45:48.703016 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: [pid: 111811|app: 0|req: 24/49] 10.222.0.27 () {60 vars in 1193 bytes} [Tue Sep 20 04:45:48 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 512 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 20 04:45:48.709395 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi [None req-8e734313-d1a2-481f-85de-ec86b4f36da2 admin admin] Calling method '>' {{(pid=111810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:45:48.724299 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: INFO nova.api.openstack.requestlog [None req-8e734313-d1a2-481f-85de-ec86b4f36da2 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018400 Sep 20 04:45:48.725055 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: [pid: 111810|app: 0|req: 26/50] 10.222.0.27 () {60 vars in 1210 bytes} [Tue Sep 20 04:45:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 04:45:48.733945 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi [None req-84707e26-8c41-468e-b638-f7f42361fdbe admin admin] Calling method '>' {{(pid=111811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:45:48.749281 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: INFO nova.api.openstack.requestlog [None req-84707e26-8c41-468e-b638-f7f42361fdbe admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018773 Sep 20 04:45:48.749791 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: [pid: 111811|app: 0|req: 25/51] 10.222.0.27 () {60 vars in 1210 bytes} [Tue Sep 20 04:45:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 04:45:48.759414 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi [None req-a5ebdf82-4d2a-4a67-b3c6-c621bdebf906 admin admin] Calling method '>' {{(pid=111810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:45:48.764247 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: INFO nova.api.openstack.wsgi [None req-a5ebdf82-4d2a-4a67-b3c6-c621bdebf906 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 20 04:45:48.765791 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi [None req-a5ebdf82-4d2a-4a67-b3c6-c621bdebf906 admin admin] Request method failure captured: Sep 20 04:45:48.765791 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 20 04:45:48.765791 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: Accept: application/json Sep 20 04:45:48.765791 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: Accept-Encoding: gzip, deflate Sep 20 04:45:48.765791 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: Connection: keep-alive Sep 20 04:45:48.765791 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: Content-Length: 0 Sep 20 04:45:48.765791 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: Host: 10.222.0.27 Sep 20 04:45:48.765791 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: Openstack-Api-Version: compute 2.92 Sep 20 04:45:48.765791 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: Openstack-System-Scope: None Sep 20 04:45:48.765791 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: User-Agent: python-novaclient Sep 20 04:45:48.765791 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-Auth-Token: gAAAAABjKUV7HmkxgY9pTRPqNEW-fnhjp8NOCyi6NWMiQ9ynQu54Er0ChEYFQoSe5HG9U-O5IQ5s4RpfnJVHZyDANkmBb867jwtMHDPmq8_zT55pgB1Fli-9Hd9nGHPmuYx_eTBh8ZJx2TGilC-QIDTzZYgfzl-bqvyH0QgXpBxKYy7zJJQSMOs Sep 20 04:45:48.765791 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-Domain-Id: None Sep 20 04:45:48.765791 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-Domain-Name: None Sep 20 04:45:48.765791 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-Identity-Status: Confirmed Sep 20 04:45:48.765791 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-Is-Admin-Project: True Sep 20 04:45:48.765791 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-Openstack-Nova-Api-Version: 2.92 Sep 20 04:45:48.765791 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-Project-Domain-Id: default Sep 20 04:45:48.765791 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-Project-Domain-Name: Default Sep 20 04:45:48.765791 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-Project-Id: 612c023f1ed44b9f936be9c752c292ec Sep 20 04:45:48.765791 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-Project-Name: admin Sep 20 04:45:48.765791 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-Role: member,reader,admin Sep 20 04:45:48.765791 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-Roles: member,reader,admin Sep 20 04:45:48.767348 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/612c023f1ed44b9f936be9c752c292ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/612c023f1ed44b9f936be9c752c292ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_612c023f1ed44b9f936be9c752c292ec", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/612c023f1ed44b9f936be9c752c292ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 04:45:48.767348 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-Tenant: admin Sep 20 04:45:48.767348 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-Tenant-Id: 612c023f1ed44b9f936be9c752c292ec Sep 20 04:45:48.767348 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-Tenant-Name: admin Sep 20 04:45:48.767348 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-User: admin Sep 20 04:45:48.767348 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-User-Domain-Id: default Sep 20 04:45:48.767348 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-User-Domain-Name: Default Sep 20 04:45:48.767348 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-User-Id: 095a92acb2e04f44b21db4de77e2a16a Sep 20 04:45:48.767348 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: X-User-Name: admin Sep 20 04:45:48.767348 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: method: > Sep 20 04:45:48.767348 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: exception: Flavor 451 could not be found. Sep 20 04:45:48.767348 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: action_args: {'id': '451'} Sep 20 04:45:48.767348 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: {{(pid=111810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 04:45:48.767348 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:45:48.768272 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 20 04:45:48.768272 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 20 04:45:48.768272 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 20 04:45:48.768272 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 20 04:45:48.768272 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 20 04:45:48.768272 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 20 04:45:48.768272 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 20 04:45:48.768272 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 20 04:45:48.768272 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 20 04:45:48.768272 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 04:45:48.768272 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 20 04:45:48.768272 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 20 04:45:48.768272 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 20 04:45:48.768272 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi Sep 20 04:45:48.768272 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:45:48.768272 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi Sep 20 04:45:48.768272 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:45:48.768272 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:45:48.768272 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:45:48.769723 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 04:45:48.769723 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 04:45:48.769723 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 04:45:48.769723 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 04:45:48.769723 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 20 04:45:48.769723 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 20 04:45:48.769723 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 20 04:45:48.769723 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi Sep 20 04:45:48.769723 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:45:48.769723 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi Sep 20 04:45:48.769723 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:45:48.769723 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:45:48.769723 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:45:48.769723 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 04:45:48.769723 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 04:45:48.769723 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 20 04:45:48.769723 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: ERROR nova.api.openstack.wsgi Sep 20 04:45:48.769723 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi [None req-a5ebdf82-4d2a-4a67-b3c6-c621bdebf906 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=111810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 04:45:48.770783 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: INFO nova.api.openstack.requestlog [None req-a5ebdf82-4d2a-4a67-b3c6-c621bdebf906 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011201 Sep 20 04:45:48.770783 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: [pid: 111810|app: 0|req: 27/52] 10.222.0.27 () {60 vars in 1193 bytes} [Tue Sep 20 04:45:48 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 20 04:45:49.970786 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi [None req-84707e26-8c41-468e-b638-f7f42361fdbe admin admin] Calling method '>' {{(pid=111811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:45:49.971788 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: INFO nova.api.openstack.requestlog [None req-84707e26-8c41-468e-b638-f7f42361fdbe admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Sep 20 04:45:49.972175 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: [pid: 111811|app: 0|req: 26/53] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Sep 20 04:45:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:45:50.484152 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi [None req-80dd45c9-1654-479b-b8bc-5f9804ea66ea admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:45:50.503527 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: INFO nova.api.openstack.requestlog [None req-80dd45c9-1654-479b-b8bc-5f9804ea66ea admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.392784 Sep 20 04:45:50.504053 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: [pid: 111810|app: 0|req: 28/54] 10.222.0.27 () {64 vars in 1235 bytes} [Tue Sep 20 04:45:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 20 04:45:51.721983 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi [None req-84707e26-8c41-468e-b638-f7f42361fdbe admin admin] Calling method '>' {{(pid=111811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:45:51.722971 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: INFO nova.api.openstack.requestlog [None req-84707e26-8c41-468e-b638-f7f42361fdbe admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Sep 20 04:45:51.723364 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: [pid: 111811|app: 0|req: 27/55] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Sep 20 04:45:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:45:52.244997 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi [None req-29fb8c62-2f02-404a-96c2-56de47345f4e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:45:52.263545 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: INFO nova.api.openstack.requestlog [None req-29fb8c62-2f02-404a-96c2-56de47345f4e admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.400470 Sep 20 04:45:52.264092 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: [pid: 111810|app: 0|req: 29/56] 10.222.0.27 () {64 vars in 1235 bytes} [Tue Sep 20 04:45:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 20 04:45:53.475031 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi [None req-84707e26-8c41-468e-b638-f7f42361fdbe admin admin] Calling method '>' {{(pid=111811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:45:53.476057 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: INFO nova.api.openstack.requestlog [None req-84707e26-8c41-468e-b638-f7f42361fdbe admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Sep 20 04:45:53.476445 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: [pid: 111811|app: 0|req: 28/57] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Sep 20 04:45:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:45:53.989725 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi [None req-e37c9868-1ff3-456d-8950-2a494a41dab4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:45:54.007964 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: INFO nova.api.openstack.requestlog [None req-e37c9868-1ff3-456d-8950-2a494a41dab4 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.393912 Sep 20 04:45:54.008494 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: [pid: 111810|app: 0|req: 30/58] 10.222.0.27 () {64 vars in 1235 bytes} [Tue Sep 20 04:45:53 2022] POST /compute/v2.1/flavors => generated 407 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 20 04:45:55.246948 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi [None req-84707e26-8c41-468e-b638-f7f42361fdbe admin admin] Calling method '>' {{(pid=111811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:45:55.247939 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: INFO nova.api.openstack.requestlog [None req-84707e26-8c41-468e-b638-f7f42361fdbe admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Sep 20 04:45:55.248324 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: [pid: 111811|app: 0|req: 29/59] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Sep 20 04:45:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:45:55.771740 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi [None req-d8534fbe-29bb-4a4f-b587-a1cc41db05a5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:45:55.789301 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: INFO nova.api.openstack.requestlog [None req-d8534fbe-29bb-4a4f-b587-a1cc41db05a5 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.403525 Sep 20 04:45:55.789836 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: [pid: 111810|app: 0|req: 31/60] 10.222.0.27 () {64 vars in 1235 bytes} [Tue Sep 20 04:45:55 2022] POST /compute/v2.1/flavors => generated 409 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 20 04:45:57.010085 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi [None req-84707e26-8c41-468e-b638-f7f42361fdbe admin admin] Calling method '>' {{(pid=111811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:45:57.011102 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: INFO nova.api.openstack.requestlog [None req-84707e26-8c41-468e-b638-f7f42361fdbe admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Sep 20 04:45:57.011496 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: [pid: 111811|app: 0|req: 30/61] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Sep 20 04:45:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:45:57.526045 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi [None req-bccd6ce8-4305-4a54-ba07-4df57e971f63 admin admin] Calling method '>' {{(pid=111810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:45:57.547303 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: INFO nova.api.openstack.requestlog [None req-bccd6ce8-4305-4a54-ba07-4df57e971f63 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.399896 Sep 20 04:45:57.547852 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: [pid: 111810|app: 0|req: 32/62] 10.222.0.27 () {60 vars in 1202 bytes} [Tue Sep 20 04:45:57 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 04:46:53.886887 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi [None req-84707e26-8c41-468e-b638-f7f42361fdbe admin admin] Calling method '>' {{(pid=111811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:46:53.887899 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: INFO nova.api.openstack.requestlog [None req-84707e26-8c41-468e-b638-f7f42361fdbe admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Sep 20 04:46:53.888303 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: [pid: 111811|app: 0|req: 31/63] 10.222.0.27 () {54 vars in 931 bytes} [Tue Sep 20 04:46:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:46:53.898919 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG dbcounter [-] [111810] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=111810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:46:54.274385 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi [None req-98f54201-b0c9-48d3-a9d7-b9930bd84b14 admin admin] Calling method '>' {{(pid=111810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:46:54.295092 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: INFO nova.api.openstack.requestlog [None req-98f54201-b0c9-48d3-a9d7-b9930bd84b14 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.400898 Sep 20 04:46:54.295616 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: [pid: 111810|app: 0|req: 33/64] 10.222.0.27 () {60 vars in 1292 bytes} [Tue Sep 20 04:46:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 04:46:54.316814 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG dbcounter [-] [111811] Writing DB stats nova_api:SELECT=14 {{(pid=111811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:46:54.320668 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi [None req-7669709d-f8e3-4063-a3e5-eb44a7c44884 admin admin] Calling method '>' {{(pid=111811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:46:54.327855 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: INFO nova.api.openstack.requestlog [None req-7669709d-f8e3-4063-a3e5-eb44a7c44884 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012536 Sep 20 04:46:54.328374 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: [pid: 111811|app: 0|req: 32/65] 10.222.0.27 () {60 vars in 1283 bytes} [Tue Sep 20 04:46:54 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:46:54.339542 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi [None req-e5a4e1d8-8f30-4956-85f1-d8c043cca71c admin admin] Calling method '>' {{(pid=111810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:46:54.347134 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: INFO nova.api.openstack.requestlog [None req-e5a4e1d8-8f30-4956-85f1-d8c043cca71c admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011071 Sep 20 04:46:54.347634 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: [pid: 111810|app: 0|req: 34/66] 10.222.0.27 () {60 vars in 1286 bytes} [Tue Sep 20 04:46:54 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:46:54.358403 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi [None req-c833c299-9007-4eb1-8a51-9612b31f5293 admin admin] Calling method '>' {{(pid=111811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:46:54.366050 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: INFO nova.api.openstack.requestlog [None req-c833c299-9007-4eb1-8a51-9612b31f5293 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011092 Sep 20 04:46:54.366565 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: [pid: 111811|app: 0|req: 33/67] 10.222.0.27 () {60 vars in 1286 bytes} [Tue Sep 20 04:46:54 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:46:54.377321 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi [None req-0df1cb8b-389d-4067-9cec-31913379d0c7 admin admin] Calling method '>' {{(pid=111810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:46:54.384119 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: INFO nova.api.openstack.requestlog [None req-0df1cb8b-389d-4067-9cec-31913379d0c7 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010153 Sep 20 04:46:54.384635 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: [pid: 111810|app: 0|req: 35/68] 10.222.0.27 () {60 vars in 1283 bytes} [Tue Sep 20 04:46:54 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:49:53.530656 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi [None req-c833c299-9007-4eb1-8a51-9612b31f5293 admin admin] Calling method '>' {{(pid=111811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:49:53.531665 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: INFO nova.api.openstack.requestlog [None req-c833c299-9007-4eb1-8a51-9612b31f5293 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Sep 20 04:49:53.532056 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: [pid: 111811|app: 0|req: 34/69] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Sep 20 04:49:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:49:53.670001 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG dbcounter [-] [111810] Writing DB stats nova_api:SELECT=6 {{(pid=111810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:49:53.827007 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi [None req-9f71a01c-355f-4d6f-8e7c-eae35fb793e4 admin admin] Calling method '>' {{(pid=111810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:49:53.831761 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG oslo_concurrency.lockutils [None req-9f71a01c-355f-4d6f-8e7c-eae35fb793e4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:49:53.832229 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG oslo_concurrency.lockutils [None req-9f71a01c-355f-4d6f-8e7c-eae35fb793e4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:49:53.832885 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG oslo_concurrency.lockutils [None req-9f71a01c-355f-4d6f-8e7c-eae35fb793e4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:49:53.833594 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG oslo_concurrency.lockutils [None req-9f71a01c-355f-4d6f-8e7c-eae35fb793e4 admin admin] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:49:53.834032 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG oslo_concurrency.lockutils [None req-9f71a01c-355f-4d6f-8e7c-eae35fb793e4 admin admin] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:49:53.834445 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG oslo_concurrency.lockutils [None req-9f71a01c-355f-4d6f-8e7c-eae35fb793e4 admin admin] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:49:53.866278 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: INFO nova.api.openstack.requestlog [None req-9f71a01c-355f-4d6f-8e7c-eae35fb793e4 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.197430 Sep 20 04:49:53.866833 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: [pid: 111810|app: 0|req: 36/70] 10.222.0.27 () {60 vars in 1193 bytes} [Tue Sep 20 04:49:53 2022] GET /compute/v2.1/os-services => generated 791 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 20 04:49:54.980748 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi [None req-c833c299-9007-4eb1-8a51-9612b31f5293 admin admin] Calling method '>' {{(pid=111811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:49:54.981748 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: INFO nova.api.openstack.requestlog [None req-c833c299-9007-4eb1-8a51-9612b31f5293 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Sep 20 04:49:54.982173 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: [pid: 111811|app: 0|req: 35/71] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Sep 20 04:49:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:49:55.176858 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi [None req-d0d34664-e5de-4eee-97c3-f3930888a0bf admin admin] Calling method '>' {{(pid=111810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:49:55.180183 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG oslo_concurrency.lockutils [None req-d0d34664-e5de-4eee-97c3-f3930888a0bf admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:49:55.180683 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG oslo_concurrency.lockutils [None req-d0d34664-e5de-4eee-97c3-f3930888a0bf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:49:55.181104 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG oslo_concurrency.lockutils [None req-d0d34664-e5de-4eee-97c3-f3930888a0bf admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:49:55.181841 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG oslo_concurrency.lockutils [None req-d0d34664-e5de-4eee-97c3-f3930888a0bf admin admin] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:49:55.182282 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG oslo_concurrency.lockutils [None req-d0d34664-e5de-4eee-97c3-f3930888a0bf admin admin] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:49:55.182690 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG oslo_concurrency.lockutils [None req-d0d34664-e5de-4eee-97c3-f3930888a0bf admin admin] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:49:55.202824 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: INFO nova.api.openstack.requestlog [None req-d0d34664-e5de-4eee-97c3-f3930888a0bf admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.080898 Sep 20 04:49:55.203350 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: [pid: 111810|app: 0|req: 37/72] 10.222.0.27 () {60 vars in 1193 bytes} [Tue Sep 20 04:49:55 2022] GET /compute/v2.1/os-services => generated 791 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 20 04:50:06.687492 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi [None req-c833c299-9007-4eb1-8a51-9612b31f5293 admin admin] Calling method '>' {{(pid=111811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:50:06.688490 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: INFO nova.api.openstack.requestlog [None req-c833c299-9007-4eb1-8a51-9612b31f5293 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001401 Sep 20 04:50:06.688911 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: [pid: 111811|app: 0|req: 36/73] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Sep 20 04:50:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:50:06.831557 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG dbcounter [-] [111810] Writing DB stats nova_cell0:SELECT=4 {{(pid=111810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:50:06.832272 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG dbcounter [-] [111810] Writing DB stats nova_cell1:SELECT=4 {{(pid=111810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:50:06.832907 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG dbcounter [-] [111810] Writing DB stats nova_api:SELECT=8 {{(pid=111810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:50:06.880382 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi [None req-65a854c5-1b11-47aa-9ea8-48a298615361 admin admin] Calling method '>' {{(pid=111810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:50:06.883755 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG oslo_concurrency.lockutils [None req-65a854c5-1b11-47aa-9ea8-48a298615361 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:50:06.884234 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG oslo_concurrency.lockutils [None req-65a854c5-1b11-47aa-9ea8-48a298615361 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:50:06.884689 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG oslo_concurrency.lockutils [None req-65a854c5-1b11-47aa-9ea8-48a298615361 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:50:06.885402 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG oslo_concurrency.lockutils [None req-65a854c5-1b11-47aa-9ea8-48a298615361 admin admin] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:50:06.886340 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG oslo_concurrency.lockutils [None req-65a854c5-1b11-47aa-9ea8-48a298615361 admin admin] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:50:06.886757 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG oslo_concurrency.lockutils [None req-65a854c5-1b11-47aa-9ea8-48a298615361 admin admin] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=111810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:50:06.911921 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: INFO nova.api.openstack.requestlog [None req-65a854c5-1b11-47aa-9ea8-48a298615361 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.084659 Sep 20 04:50:06.912397 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: [pid: 111810|app: 0|req: 38/74] 10.222.0.27 () {60 vars in 1193 bytes} [Tue Sep 20 04:50:06 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 04:50:07.974524 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG nova.api.openstack.wsgi [None req-c833c299-9007-4eb1-8a51-9612b31f5293 admin admin] Calling method '>' {{(pid=111811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:50:07.975509 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: INFO nova.api.openstack.requestlog [None req-c833c299-9007-4eb1-8a51-9612b31f5293 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001401 Sep 20 04:50:07.975900 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: [pid: 111811|app: 0|req: 37/75] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Sep 20 04:50:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:50:08.170127 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG nova.api.openstack.wsgi [None req-89597c15-71e4-49f5-bc15-35a943e9488a admin admin] Calling method '>' {{(pid=111810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:50:08.173498 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG oslo_concurrency.lockutils [None req-89597c15-71e4-49f5-bc15-35a943e9488a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:50:08.173970 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG oslo_concurrency.lockutils [None req-89597c15-71e4-49f5-bc15-35a943e9488a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:50:08.174398 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG oslo_concurrency.lockutils [None req-89597c15-71e4-49f5-bc15-35a943e9488a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:50:08.175103 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG oslo_concurrency.lockutils [None req-89597c15-71e4-49f5-bc15-35a943e9488a admin admin] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:50:08.175549 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG oslo_concurrency.lockutils [None req-89597c15-71e4-49f5-bc15-35a943e9488a admin admin] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:50:08.175960 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: DEBUG oslo_concurrency.lockutils [None req-89597c15-71e4-49f5-bc15-35a943e9488a admin admin] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:50:08.197339 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: INFO nova.api.openstack.requestlog [None req-89597c15-71e4-49f5-bc15-35a943e9488a admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.081071 Sep 20 04:50:08.197878 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: [pid: 111810|app: 0|req: 39/76] 10.222.0.27 () {60 vars in 1193 bytes} [Tue Sep 20 04:50:08 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 04:51:03.699267 dv-cinder-756710-7-iscsi devstack@n-api.service[111809]: Tue Sep 20 04:51:03 2022 - graceful shutdown triggered... Sep 20 04:51:03.699363 dv-cinder-756710-7-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 20 04:51:03.700369 dv-cinder-756710-7-iscsi devstack@n-api.service[111810]: Gracefully killing worker 1 (pid: 111810)... Sep 20 04:51:03.700834 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: Gracefully killing worker 2 (pid: 111811)... Sep 20 04:51:03.833555 dv-cinder-756710-7-iscsi devstack@n-api.service[111811]: DEBUG dbcounter [-] [111811] Writing DB stats nova_api:SELECT=4 {{(pid=111811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:51:04.700724 dv-cinder-756710-7-iscsi devstack@n-api.service[111809]: worker 1 buried after 1 seconds Sep 20 04:51:04.701252 dv-cinder-756710-7-iscsi devstack@n-api.service[111809]: worker 2 buried after 1 seconds Sep 20 04:51:04.701252 dv-cinder-756710-7-iscsi devstack@n-api.service[111809]: goodbye to uWSGI. Sep 20 04:51:04.702330 dv-cinder-756710-7-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 20 04:51:04.702919 dv-cinder-756710-7-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 20 04:51:04.705770 dv-cinder-756710-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 20 04:51:04.715074 dv-cinder-756710-7-iscsi devstack@n-api.service[126792]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 20 04:51:04.717334 dv-cinder-756710-7-iscsi devstack@n-api.service[126792]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 20 04:51:04 2022] *** Sep 20 04:51:04.717334 dv-cinder-756710-7-iscsi devstack@n-api.service[126792]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 20 04:51:04.717334 dv-cinder-756710-7-iscsi devstack@n-api.service[126792]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 20 04:51:04.717334 dv-cinder-756710-7-iscsi devstack@n-api.service[126792]: nodename: dv-cinder-756710-7-iscsi Sep 20 04:51:04.717334 dv-cinder-756710-7-iscsi devstack@n-api.service[126792]: machine: x86_64 Sep 20 04:51:04.717334 dv-cinder-756710-7-iscsi devstack@n-api.service[126792]: clock source: unix Sep 20 04:51:04.717334 dv-cinder-756710-7-iscsi devstack@n-api.service[126792]: pcre jit disabled Sep 20 04:51:04.717334 dv-cinder-756710-7-iscsi devstack@n-api.service[126792]: detected number of CPU cores: 4 Sep 20 04:51:04.717334 dv-cinder-756710-7-iscsi devstack@n-api.service[126792]: current working directory: / Sep 20 04:51:04.717334 dv-cinder-756710-7-iscsi devstack@n-api.service[126792]: detected binary path: /usr/bin/uwsgi-core Sep 20 04:51:04.717334 dv-cinder-756710-7-iscsi devstack@n-api.service[126792]: your processes number limit is 47680 Sep 20 04:51:04.718120 dv-cinder-756710-7-iscsi devstack@n-api.service[126792]: your memory page size is 4096 bytes Sep 20 04:51:04.718120 dv-cinder-756710-7-iscsi devstack@n-api.service[126792]: detected max file descriptor number: 2048 Sep 20 04:51:04.718120 dv-cinder-756710-7-iscsi devstack@n-api.service[126792]: lock engine: pthread robust mutexes Sep 20 04:51:04.718120 dv-cinder-756710-7-iscsi devstack@n-api.service[126792]: thunder lock: enabled Sep 20 04:51:04.718120 dv-cinder-756710-7-iscsi devstack@n-api.service[126792]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 20 04:51:04.718120 dv-cinder-756710-7-iscsi devstack@n-api.service[126792]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 20 04:51:04.758300 dv-cinder-756710-7-iscsi devstack@n-api.service[126792]: Python main interpreter initialized at 0x55b59ce839c0 Sep 20 04:51:04.758300 dv-cinder-756710-7-iscsi devstack@n-api.service[126792]: python threads support enabled Sep 20 04:51:04.758300 dv-cinder-756710-7-iscsi devstack@n-api.service[126792]: your server socket listen backlog is limited to 100 connections Sep 20 04:51:04.758300 dv-cinder-756710-7-iscsi devstack@n-api.service[126792]: your mercy for graceful operations on workers is 90 seconds Sep 20 04:51:04.758745 dv-cinder-756710-7-iscsi devstack@n-api.service[126792]: mapped 403077 bytes (393 KB) for 2 cores Sep 20 04:51:04.758745 dv-cinder-756710-7-iscsi devstack@n-api.service[126792]: *** Operational MODE: preforking *** Sep 20 04:51:04.759039 dv-cinder-756710-7-iscsi devstack@n-api.service[126792]: *** uWSGI is running in multiple interpreter mode *** Sep 20 04:51:04.759039 dv-cinder-756710-7-iscsi devstack@n-api.service[126792]: spawned uWSGI master process (pid: 126792) Sep 20 04:51:04.759242 dv-cinder-756710-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 20 04:51:04.759858 dv-cinder-756710-7-iscsi devstack@n-api.service[126792]: spawned uWSGI worker 1 (pid: 126813, cores: 1) Sep 20 04:51:04.772923 dv-cinder-756710-7-iscsi devstack@n-api.service[126792]: spawned uWSGI worker 2 (pid: 126814, cores: 1) Sep 20 04:51:04.772923 dv-cinder-756710-7-iscsi devstack@n-api.service[126792]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 20 04:51:05.439899 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 20 04:51:05.447969 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 20 04:51:06.609591 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 20 04:51:06.609591 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: from cryptography.utils import int_from_bytes Sep 20 04:51:06.610214 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 20 04:51:06.610214 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: from cryptography.utils import int_from_bytes Sep 20 04:51:06.611369 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 20 04:51:06.611369 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: from cryptography.utils import int_from_bytes Sep 20 04:51:06.611811 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 20 04:51:06.611811 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: from cryptography.utils import int_from_bytes Sep 20 04:51:09.021975 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 20 04:51:09.022676 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 20 04:51:09.022794 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 20 04:51:09.023127 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 20 04:51:09.023386 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 20 04:51:09.023781 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.024115 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.024440 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.024796 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.025136 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.025451 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.025775 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.026097 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.026430 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.026701 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.027022 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.028146 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-756710-7-iscsi {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.028481 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.028826 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.029148 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.029473 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.029784 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.030111 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.030430 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.030800 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 20 04:51:09.031252 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.031347 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 20 04:51:09.031421 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.031587 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 20 04:51:09.031715 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.031936 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 20 04:51:09.032079 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.032201 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 20 04:51:09.032322 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.032557 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.032785 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.032996 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.033203 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.033402 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.033599 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.033796 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.033997 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.034194 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.034394 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.034591 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.034778 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.034976 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.035187 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-756710-7-iscsi {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.035410 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.035609 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.035808 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.035997 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.036209 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.036409 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.036614 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.036818 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.037025 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-756710-7-iscsi {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.037226 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.037392 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.037559 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.037732 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.037874 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.038008 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.038190 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.038331 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.038463 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.038594 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.038736 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.038893 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.039115 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.039252 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.039391 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.039391 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.039661 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.039825 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.039969 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.040107 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.040269 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.040402 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.040548 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.041068 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.041217 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.041357 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.041500 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.041631 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.041768 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.041914 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.042073 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.042208 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.042340 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.042470 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.042610 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.042756 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.042958 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.043099 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.043235 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-756710-7-iscsi {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.043378 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.043513 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.043652 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.043794 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.043926 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.044058 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.044208 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.044208 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.044467 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.044627 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.044760 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.044913 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.045047 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.045178 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.045336 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.045478 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.045617 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.045759 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.045898 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.046056 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.046194 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.046326 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.046465 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.046612 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.046756 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.046901 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.047039 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.047178 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.047325 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.047467 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.047600 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.047731 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.047862 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.047862 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.048131 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.048131 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.048389 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.048528 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.048679 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.048679 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.049526 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.049675 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.049808 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.049940 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.050084 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.050223 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.050365 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.050505 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.050649 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.050789 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.051153 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.051310 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.051446 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.051584 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.051739 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.051956 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.052094 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.052245 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.052378 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.052510 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.052667 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.052814 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.052955 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.053100 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.053233 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.053363 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.053501 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.053633 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.053779 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.053911 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.054042 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.054172 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.054317 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.054456 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.054601 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.054733 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.054866 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.055008 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.055148 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.055287 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.055428 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.055568 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.055706 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.055840 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.055971 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.056108 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.056250 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.056389 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.056521 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.056668 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.056812 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.056952 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.057098 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.057246 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.057386 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.057518 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.057649 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.057794 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.057928 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.058095 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.058239 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.058376 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.058508 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.059197 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.059332 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.059471 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.059621 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.059760 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.059906 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.060040 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.060186 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.060332 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.060478 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.060676 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.060811 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.060966 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.061306 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.061452 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.061600 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.061733 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.061872 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.062011 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.062152 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.062293 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.062437 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.062568 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.062706 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.062846 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.062977 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.063124 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.063259 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.063390 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.063529 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.063661 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.063792 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.063932 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.064071 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.064210 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.064351 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.064473 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.064623 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.064774 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.064908 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.065049 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.065189 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.065323 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.065454 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.065665 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.065806 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.065938 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.066078 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.066221 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.066363 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.066497 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.066635 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.066775 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.066914 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.067046 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.067193 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.067333 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.067466 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.067617 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.067750 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.067889 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.068028 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.068160 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.068299 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.068442 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.068582 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.068786 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.068786 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.069044 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.069186 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.069333 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.069467 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.069598 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.069730 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.069865 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.070005 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.070144 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.070285 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.070424 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.070564 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.070696 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.070841 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.070980 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.071112 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.071449 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.071595 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.071729 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.071875 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.072016 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.072156 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.072296 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.072425 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.072558 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.072724 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.072865 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.072998 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.073145 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.073277 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.073422 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.073562 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.073695 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.073827 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.073966 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.074105 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.074105 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.074946 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.075080 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.075218 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.075358 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:51:09.075491 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.075634 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.075775 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.075916 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.076049 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.076194 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.076336 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.076469 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.076638 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.076785 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.076921 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.077053 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.077184 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.077315 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.077462 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.077603 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.077743 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.077876 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.078008 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.078153 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.078292 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.078432 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.078564 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.078695 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.078827 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.078969 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.079109 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.079241 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.079380 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.079519 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.079651 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.079800 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.079941 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.080082 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.080222 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.080355 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.080486 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.080683 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.080819 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.080958 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.081092 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.081223 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.081567 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.081717 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.081858 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.081990 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.082123 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.082262 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.082404 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.082544 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.082685 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.082817 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.082957 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.083091 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.083236 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.083376 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.083506 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.083644 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.083776 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.083953 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.084100 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.084264 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.084410 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.084575 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.084738 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.084925 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.085061 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.085235 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.085374 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.085545 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.085690 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.085862 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.086000 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.086170 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.086313 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.086487 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.086630 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.086800 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.086938 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.087110 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.087253 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.087417 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.087560 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.087734 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.088015 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.088152 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.088334 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.088481 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.088669 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.088820 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.088955 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.089093 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.089279 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.089418 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.089594 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.089731 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.089929 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.090067 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.090254 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.090401 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.090613 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.090754 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.090888 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.091028 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.091161 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.091299 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.091445 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.091801 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.091936 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.092076 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.092215 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.092349 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.092495 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.092665 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.092808 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.092949 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.093082 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.093236 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.094288 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.094432 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.094577 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.094713 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.094853 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.095013 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.096011 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.096167 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.096304 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.096439 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.096584 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.096756 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.096899 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.097032 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.097164 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.097296 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.097429 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.097574 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.097715 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.097859 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.097992 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.098124 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.098271 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.098415 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.098556 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.098689 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.098829 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.098962 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.099108 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.099241 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.099380 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.099522 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.099655 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.099794 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.099942 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.100075 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.100210 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.100342 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.100480 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.104079 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.104264 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.104412 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.104551 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.104709 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.104845 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.104999 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.105137 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.105276 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.105450 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.105602 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.105717 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.105840 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.106009 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.106142 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.106282 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.106414 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.106553 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.106684 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.106806 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.106945 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.107076 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.107212 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.107347 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.107347 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.107631 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.107764 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.107896 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.108009 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.108398 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.108568 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.108568 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.108568 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.108568 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.108568 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.108568 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.108568 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.108568 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.109851 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.109994 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.110185 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.110369 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.110512 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.110512 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.110898 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.110898 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.111122 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.111271 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.111412 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.111534 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.111660 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.111792 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.111928 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.112059 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.112197 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.112329 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.112461 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.112616 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.112765 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.112907 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.113054 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.113178 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.113317 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.113566 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.113720 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.113866 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.114314 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.114314 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.114314 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.114314 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.114314 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.114314 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.115070 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.115202 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.115342 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.115484 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.115632 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.115765 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.115905 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.116038 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.116169 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.116310 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.116441 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.116587 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.116740 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.116885 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.117029 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.117176 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.117311 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.117444 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.117576 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.117709 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.117841 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.117982 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.118126 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.118258 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.118398 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.118532 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.118672 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.118820 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.118954 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.119590 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.119740 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.119876 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.120024 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.120166 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.120300 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.120432 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.120570 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.120758 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.120908 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.121553 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.121692 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.121813 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.121946 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.122086 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.122234 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.122368 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.122508 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.122648 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.122782 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.122923 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.123066 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.123208 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.123341 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.123471 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.123611 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.123825 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.123968 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.124118 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.124460 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.124614 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.124762 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.124905 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.125049 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.125190 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.125329 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.125462 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.125594 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.125740 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.125874 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.126013 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.126148 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.126286 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.126427 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.126569 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.126710 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.126842 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.126842 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.127101 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.127250 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.127390 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.127524 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.127657 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.127789 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.127922 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.128055 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.128179 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.128296 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.128415 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.128530 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.128685 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.128821 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.128946 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.129067 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.129189 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.129311 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.129432 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.129558 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.129679 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.129800 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.129922 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.130042 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.130178 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.130305 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.130419 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.130530 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.130642 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.130771 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.130902 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.131020 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.131153 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.131276 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.131398 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.131511 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.131677 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.131811 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.131949 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.132081 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.132220 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.132353 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.132498 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.132647 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.132792 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.132932 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.133087 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.133233 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.133367 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.133500 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.133631 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.133762 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.133884 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.134027 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.134157 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.134288 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.134641 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.134788 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.134929 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.135075 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.135208 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.135339 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.135339 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.135598 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.135738 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.135881 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.136029 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.136163 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.136295 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.136435 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.136584 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.137335 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.137476 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.137619 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.137766 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.137900 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.138039 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.138172 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.138172 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.138437 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.138580 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.138724 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.138858 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.138991 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.139131 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.139273 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.139406 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.139538 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.139679 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.139826 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.139967 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.140089 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.140202 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.140314 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.140453 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.140594 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.140759 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.140953 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.141096 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.141238 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.141386 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.141527 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.141661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.141801 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.141935 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.142067 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.142208 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.142341 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.142473 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.142620 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.142763 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.142898 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.143040 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.143181 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.143368 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.143506 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.143682 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.143828 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.144027 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.144163 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.144304 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.144438 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.144773 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.144925 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.144925 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.145187 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.145321 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.145453 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.145582 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.145712 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.145852 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.145985 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.146373 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.146516 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.146658 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.146804 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.146947 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.147091 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.147225 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.147357 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.147561 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.147711 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.147868 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.148006 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.148207 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.148354 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.148539 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.148708 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.148889 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.149024 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.149385 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.149671 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.150329 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.150465 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.150582 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.150711 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.150826 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.150940 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.151064 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.151179 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.151301 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.151419 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.151540 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.151683 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.151923 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.152043 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.152164 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.152302 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.152434 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.152559 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.152729 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.152855 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.152977 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.153099 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.153214 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.153336 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.153461 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.153606 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.153748 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.153883 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.154005 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.154149 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.154283 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.154424 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.154558 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.154808 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.155020 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.155166 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.155301 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.155434 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.155575 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.155709 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.155855 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.155999 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.156133 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.156266 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.156398 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.156532 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.156692 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.156836 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.156969 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.157110 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.157817 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.157965 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.158147 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.158284 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.158426 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.158560 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.158694 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.158907 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.159042 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.159223 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.159223 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.159477 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.159619 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.159753 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.159893 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.160034 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.160174 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.160335 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.160496 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.160647 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.160775 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.160906 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.161037 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.161185 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.161363 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.161506 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.161640 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.161775 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.161907 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.162039 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.162181 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.162322 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.162498 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.162641 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.162782 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.162916 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.163056 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.163198 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.163338 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.163479 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.163611 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.163753 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.163895 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.164029 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.164161 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.164281 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.164419 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.164639 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.164805 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.165028 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.165227 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.165363 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.165508 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.165657 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.165799 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.165933 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.166054 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.166186 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.166326 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.166467 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.166631 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.166774 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.166907 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.167048 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.167195 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.167336 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.167470 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.167601 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.167733 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.167865 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.168030 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.168165 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.168305 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.168438 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.168578 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.168757 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.168900 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.169034 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.169167 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.169306 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.169439 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.169571 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.169712 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.169845 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.169978 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.170109 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.170241 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.170387 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.170528 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.170661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.170825 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.170957 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.171103 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.171251 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.171394 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.171527 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.171659 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.171791 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.171923 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.172069 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.172210 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.172353 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.172485 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.172663 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.172810 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.172953 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.173093 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.173235 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.173377 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.173510 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.173651 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.173786 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.173926 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.174068 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.174200 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.174342 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.174484 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.174625 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.174791 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.174934 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.175153 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.175366 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.175513 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.175657 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.175791 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.175932 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.176073 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.176214 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.176358 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.176501 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.176651 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.176786 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.176918 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.177064 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.177206 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.177401 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.177540 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.177711 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.177848 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.178017 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.178155 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.178326 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.178472 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.178632 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.178777 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.178946 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.179089 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.179223 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.179355 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.179588 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.179732 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.179901 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.180045 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.180249 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.180393 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.180557 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.180763 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.180905 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.181046 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.181179 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.181336 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.181903 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.182057 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.182201 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.182342 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.182483 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.182626 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.182626 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.182983 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.183129 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.183272 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.183415 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.184066 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.184205 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.184348 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.184494 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.184647 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.184796 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.184931 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.184931 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.185274 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.185483 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.185629 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.185763 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.185897 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.186039 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.186173 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.186305 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.186438 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.186571 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.186704 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.186922 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.187083 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.187216 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.187357 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.187498 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.187639 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.187786 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.187928 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.188072 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.188219 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.188366 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.188500 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.188658 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.188800 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.189015 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.189160 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.189345 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.189483 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.189661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.189808 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.189984 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.190137 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.190296 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.190433 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.190624 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.190762 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.190954 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.191101 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.191273 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.191411 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.191603 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.191740 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.191925 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.192082 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.192247 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.192392 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.192554 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.192756 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.192899 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.193047 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.193216 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.193354 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.193532 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.193669 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.193855 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.193994 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.194202 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.194338 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.194513 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.194651 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.194823 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.194961 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.195137 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.195295 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.195521 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.195720 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.195871 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.196013 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.196155 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.196289 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.196424 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.196557 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.196748 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.196884 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.197025 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.197158 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.197291 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.197439 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.197581 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.197715 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.197873 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.198011 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.198187 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.198338 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.198481 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.198614 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.198789 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.198927 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.199095 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.199778 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.199976 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.200121 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.200286 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.200423 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.200626 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.200790 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.200933 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.201077 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.201251 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.201386 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.201570 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.201715 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.201878 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.202016 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.202202 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.202352 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.202514 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.202652 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.202818 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.202963 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.203123 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.203298 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.203451 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.203628 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.203774 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.203915 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.204047 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.204179 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.204358 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.204506 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.204713 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.204852 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.205047 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.205195 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.205360 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.205512 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.205729 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.205936 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.206084 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.206233 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.206367 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.206507 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.206648 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.206789 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.206924 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.207065 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.207199 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.207339 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.207473 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.207613 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.207747 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.207891 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.208026 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.208165 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.208344 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.208490 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.208762 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.208906 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.209050 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.209191 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.209325 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.209456 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.209597 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.209731 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.209863 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.210004 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.210173 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.210311 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.210496 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.210642 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.210803 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.210955 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.211126 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.211292 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.211440 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.211574 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.211727 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.211873 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.212015 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.212159 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.212322 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.212484 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.212690 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.212840 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.213003 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.213156 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.213319 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.213462 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.213630 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.213773 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.213950 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.214094 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.214265 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.214401 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.214582 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.214724 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.214920 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.215066 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.215239 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.215377 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.215555 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.215788 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.215949 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.216124 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.216247 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.216443 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.216551 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.216786 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.216908 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.217104 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.217216 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.217423 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.217535 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.217741 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.217955 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.218067 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.218283 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.218390 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.218602 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.218748 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.218916 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.219064 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.219228 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.219400 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.219544 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.219688 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.219825 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.219958 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.220146 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.220284 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.220456 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.220636 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.220784 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.220919 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.221093 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.221239 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.221421 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.221560 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.221743 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.221880 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.222069 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.222208 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.222406 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.222552 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.222719 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.222856 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.223031 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.223181 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.223343 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.223486 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.223651 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.223794 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.223961 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.224111 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.224277 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.224423 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.224592 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.224757 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.224928 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.225079 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.225225 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.225359 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.225537 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.225682 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.225841 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.226066 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.226280 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.226417 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.226558 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.226692 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.226842 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.226985 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.227119 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.227252 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.227392 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.227537 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.227685 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.227830 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.228427 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.228564 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.228764 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.228918 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.229053 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.229053 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.229313 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.229453 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.229594 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.229741 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.229881 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.230024 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.230167 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.230167 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.230439 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.230594 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.230728 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.230861 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.230995 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.231135 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.231269 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.231411 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.231545 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.231678 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.231857 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.231997 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.232175 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.232322 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.232506 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.232663 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.232842 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.232982 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.233152 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.233291 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.233465 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.233603 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.233777 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.234029 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.234181 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.234385 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.234530 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.234694 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.234837 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.234997 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.235146 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.235317 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.235490 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.235631 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.235764 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.235952 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.236173 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.236386 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.236530 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.236729 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.236874 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.237023 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.237158 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.237292 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.237432 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.237574 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.237737 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.237950 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.238086 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.238219 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.238353 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.238485 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.238648 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.238799 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.238943 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.239077 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.239257 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.239396 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.239570 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.239708 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.239875 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.240020 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.240184 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.240322 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.240490 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.240646 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.240824 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.240961 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.241128 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.241263 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.241435 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.241572 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.241736 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.241878 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.242041 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.242184 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.242349 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.242496 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.242665 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.242802 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.242973 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.243120 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.243316 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.243451 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.243622 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.243758 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.243928 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.244080 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.244222 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.244364 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.244527 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.244705 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.244867 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.245013 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.245155 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.245296 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.245543 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.245682 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.245848 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.246000 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.246772 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.246907 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.247041 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.247172 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.247321 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.247456 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.247597 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.247740 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.247898 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.248042 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.248214 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.248351 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.248519 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.248675 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.248930 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.249111 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.249266 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.249452 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.249590 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.249775 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.249913 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.250114 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.250264 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.250455 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.250594 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.250770 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.250909 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.251081 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.251307 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.251445 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.251641 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.251824 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.251960 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.252103 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.252279 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.252426 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.252643 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.252795 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.252938 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.253082 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.253224 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.253372 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.253507 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.253640 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.253832 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.253971 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.254142 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.254288 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.254452 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.254595 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.254748 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.254882 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.255055 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.255200 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.255365 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.255500 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.255670 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.255814 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.255979 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.256116 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.256285 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.256435 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.256591 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.256879 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.257034 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.257179 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.257313 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.257460 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.257602 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.257737 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.257870 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.258003 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.258146 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.258291 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.258426 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.258567 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.258702 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.258836 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.259022 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.259169 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.259339 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.259477 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.259656 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.259794 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.260051 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.260198 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.260333 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.260948 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.261091 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.261239 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.261386 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.261530 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.261717 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.262341 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.262480 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.262613 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.262756 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.262900 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.263034 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.263175 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.263316 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.263465 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.263600 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.263741 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.263875 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.264008 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.264149 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.264296 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.264431 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.264574 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.264727 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.264876 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.265012 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.265156 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.265297 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.265432 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.265577 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.265711 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.265858 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.265995 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.266135 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.266265 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.266422 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.266560 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.266760 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.267036 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.267190 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.267333 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.267474 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.267643 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.267866 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.268003 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.268144 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.268285 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.268419 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.268566 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.268740 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.268886 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.269021 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.269163 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.269312 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.269455 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.269590 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.269724 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.269857 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.269990 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.270149 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.270381 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.270520 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.270661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.270797 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.270939 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.271356 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.271507 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.271648 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.271789 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.271932 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.272065 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.272208 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.272352 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.272487 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.272639 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.272786 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.272923 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.273065 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.273207 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.273349 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.273483 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.273616 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.273749 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.273892 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.274028 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.274161 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.274302 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.274444 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.274579 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.274726 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.274860 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.274994 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.275151 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.275288 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.275461 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.275600 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.275788 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.275935 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.276114 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.276259 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.276432 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.276577 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.276771 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.277043 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.277244 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.277411 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.277560 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.277703 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.277844 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.277978 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.278112 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.278254 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.278401 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.278535 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.278668 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.278809 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.278951 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.279098 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.279242 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.279376 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.279516 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.279657 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.279799 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.279947 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.280082 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.280223 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.280379 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.280514 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.280710 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.280863 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.281040 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.281187 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.281366 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.281504 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.281672 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.281812 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.281998 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.282137 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.282313 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.282453 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.282631 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.282778 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.282946 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.283098 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.283239 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.283374 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.283571 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.283737 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.283872 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.284014 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.284176 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.284357 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.284491 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.284666 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.284802 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.284947 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.285107 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.285253 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.285423 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.285561 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.285732 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.285869 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.286043 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.286189 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.286358 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.286495 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.286673 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.286810 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.286997 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.287275 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.287409 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.287557 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.287693 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.287826 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.287969 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.288103 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.288245 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.288380 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.288574 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.288729 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.288877 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 20 04:51:09.289018 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.289238 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.289566 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.290136 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.290453 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.290764 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:51:09.291005 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 20 04:51:09.350387 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO dbcounter [None req-c256ff11-49be-4142-8e35-c11e3d7d9509 None None] Registered counter for database nova_api Sep 20 04:51:09.352190 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO dbcounter [None req-79f66231-edc5-4a3e-93c8-8db05aabd3d5 None None] Registered counter for database nova_api Sep 20 04:51:09.373048 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_db.sqlalchemy.engines [None req-c256ff11-49be-4142-8e35-c11e3d7d9509 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126813) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 20 04:51:09.374722 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_db.sqlalchemy.engines [None req-79f66231-edc5-4a3e-93c8-8db05aabd3d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126814) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 20 04:51:09.379914 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writer thread running {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 20 04:51:09.381481 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG dbcounter [-] [126814] Writer thread running {{(pid=126814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 20 04:51:09.437026 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.context [None req-c256ff11-49be-4142-8e35-c11e3d7d9509 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),83c9afcc-a13c-497b-8ad2-720b11fbf77b(cell1) {{(pid=126813) load_cells /opt/stack/nova/nova/context.py:464}} Sep 20 04:51:09.440618 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.context [None req-79f66231-edc5-4a3e-93c8-8db05aabd3d5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),83c9afcc-a13c-497b-8ad2-720b11fbf77b(cell1) {{(pid=126814) load_cells /opt/stack/nova/nova/context.py:464}} Sep 20 04:51:09.441105 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c256ff11-49be-4142-8e35-c11e3d7d9509 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:51:09.441589 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c256ff11-49be-4142-8e35-c11e3d7d9509 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:51:09.443167 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c256ff11-49be-4142-8e35-c11e3d7d9509 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:51:09.444018 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c256ff11-49be-4142-8e35-c11e3d7d9509 None None] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:51:09.444515 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c256ff11-49be-4142-8e35-c11e3d7d9509 None None] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:51:09.444819 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-79f66231-edc5-4a3e-93c8-8db05aabd3d5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:51:09.445298 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-79f66231-edc5-4a3e-93c8-8db05aabd3d5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:51:09.446409 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c256ff11-49be-4142-8e35-c11e3d7d9509 None None] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:51:09.446945 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-79f66231-edc5-4a3e-93c8-8db05aabd3d5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:51:09.447751 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-79f66231-edc5-4a3e-93c8-8db05aabd3d5 None None] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:51:09.448346 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-79f66231-edc5-4a3e-93c8-8db05aabd3d5 None None] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:51:09.448517 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO dbcounter [None req-c256ff11-49be-4142-8e35-c11e3d7d9509 None None] Registered counter for database nova_cell0 Sep 20 04:51:09.450959 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-79f66231-edc5-4a3e-93c8-8db05aabd3d5 None None] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:51:09.453263 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO dbcounter [None req-c256ff11-49be-4142-8e35-c11e3d7d9509 None None] Registered counter for database nova_cell1 Sep 20 04:51:09.453424 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO dbcounter [None req-79f66231-edc5-4a3e-93c8-8db05aabd3d5 None None] Registered counter for database nova_cell0 Sep 20 04:51:09.457757 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO dbcounter [None req-79f66231-edc5-4a3e-93c8-8db05aabd3d5 None None] Registered counter for database nova_cell1 Sep 20 04:51:09.461403 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_db.sqlalchemy.engines [None req-c256ff11-49be-4142-8e35-c11e3d7d9509 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126813) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 20 04:51:09.462004 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_db.sqlalchemy.engines [None req-c256ff11-49be-4142-8e35-c11e3d7d9509 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126813) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 20 04:51:09.465425 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_db.sqlalchemy.engines [None req-79f66231-edc5-4a3e-93c8-8db05aabd3d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126814) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 20 04:51:09.467842 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_db.sqlalchemy.engines [None req-79f66231-edc5-4a3e-93c8-8db05aabd3d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126814) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 20 04:51:09.468861 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writer thread running {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 20 04:51:09.470129 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writer thread running {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 20 04:51:09.473787 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG dbcounter [-] [126814] Writer thread running {{(pid=126814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 20 04:51:09.617502 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG dbcounter [-] [126814] Writer thread running {{(pid=126814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 20 04:51:09.618349 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO dbcounter [None req-c256ff11-49be-4142-8e35-c11e3d7d9509 None None] Registered counter for database nova_cell0 Sep 20 04:51:09.626061 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_db.sqlalchemy.engines [None req-c256ff11-49be-4142-8e35-c11e3d7d9509 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126813) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 20 04:51:09.627522 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO dbcounter [None req-79f66231-edc5-4a3e-93c8-8db05aabd3d5 None None] Registered counter for database nova_cell0 Sep 20 04:51:09.631504 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writer thread running {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 20 04:51:09.634401 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_db.sqlalchemy.engines [None req-79f66231-edc5-4a3e-93c8-8db05aabd3d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126814) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 20 04:51:09.639116 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG dbcounter [-] [126814] Writer thread running {{(pid=126814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 20 04:51:09.960018 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: WARNING keystonemiddleware.auth_token [None req-c256ff11-49be-4142-8e35-c11e3d7d9509 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 20 04:51:09.963247 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: WARNING keystonemiddleware.auth_token [None req-79f66231-edc5-4a3e-93c8-8db05aabd3d5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 20 04:51:09.967760 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: WARNING keystonemiddleware.auth_token [None req-c256ff11-49be-4142-8e35-c11e3d7d9509 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 20 04:51:09.971044 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: WARNING keystonemiddleware.auth_token [None req-79f66231-edc5-4a3e-93c8-8db05aabd3d5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 20 04:51:10.315021 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: WARNING keystonemiddleware.auth_token [None req-c256ff11-49be-4142-8e35-c11e3d7d9509 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 20 04:51:10.318668 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: WARNING keystonemiddleware.auth_token [None req-79f66231-edc5-4a3e-93c8-8db05aabd3d5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 20 04:51:10.321016 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: WARNING keystonemiddleware.auth_token [None req-c256ff11-49be-4142-8e35-c11e3d7d9509 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 20 04:51:10.325173 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: WARNING keystonemiddleware.auth_token [None req-79f66231-edc5-4a3e-93c8-8db05aabd3d5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 20 04:51:10.326817 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b59ce839c0 pid: 126813 (default app) Sep 20 04:51:10.330453 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b59ce839c0 pid: 126814 (default app) Sep 20 04:51:45.808575 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_api:SELECT=3 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:51:45.810204 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell1:SELECT=3 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:51:45.811202 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell0:SELECT=3 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:51:45.824154 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell0:SELECT=3 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:51:46.229840 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG dbcounter [-] [126814] Writing DB stats nova_api:SELECT=3 {{(pid=126814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:51:46.239027 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG dbcounter [-] [126814] Writing DB stats nova_cell1:SELECT=3 {{(pid=126814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:51:46.243197 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG dbcounter [-] [126814] Writing DB stats nova_cell0:SELECT=3 {{(pid=126814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:51:46.244904 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG dbcounter [-] [126814] Writing DB stats nova_cell0:SELECT=3 {{(pid=126814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:51:47.590146 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-04689e0b-f087-4886-bba3-3791ba024643 tempest-VolumesGetTestJSON-1589417228 tempest-VolumesGetTestJSON-1589417228-project] Action: 'create', calling method: .version_select at 0x7f2e4b60c430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-548862586", "metadata": {"Type": "work"}}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:51:48.074436 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-8152fdf3-9e20-4966-83e4-aef584562c27 tempest-VolumesSnapshotsTestJSON-1738812212 tempest-VolumesSnapshotsTestJSON-1738812212-project] Action: 'create', calling method: .version_select at 0x7f2e4b60d430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1754931920"}} {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:51:50.311609 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-04689e0b-f087-4886-bba3-3791ba024643 tempest-VolumesGetTestJSON-1589417228 tempest-VolumesGetTestJSON-1589417228-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 4.515596 Sep 20 04:51:50.313104 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 1/1] 10.222.0.27 () {60 vars in 1156 bytes} [Tue Sep 20 04:51:45 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 4519 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 20 04:51:50.647834 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-caf546fe-6267-4395-a512-2dfb626479e5 tempest-VolumesNegativeTest-285428127 tempest-VolumesNegativeTest-285428127-project] Action: 'create', calling method: .version_select at 0x7f2e4b4de280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-691842085", "metadata": {"Type": "work"}}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:51:50.665869 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-caf546fe-6267-4395-a512-2dfb626479e5 tempest-VolumesNegativeTest-285428127 tempest-VolumesNegativeTest-285428127-project] Request method failure captured: Sep 20 04:51:50.665869 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 20 04:51:50.665869 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept: application/json Sep 20 04:51:50.665869 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept-Encoding: identity Sep 20 04:51:50.665869 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Connection: close Sep 20 04:51:50.665869 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Length: 121 Sep 20 04:51:50.665869 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Type: application/json Sep 20 04:51:50.665869 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Host: 10.222.0.27 Sep 20 04:51:50.665869 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Openstack-System-Scope: None Sep 20 04:51:50.665869 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: User-Agent: python-urllib3/1.26.12 Sep 20 04:51:50.665869 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Auth-Token: gAAAAABjKUbiAK7S_GOF55luEIfZQIUZM8mMdxe_DuHJ6VE_zA_TxS-UF2KFvCH9u0HYCVZA1iqsJuM16E2cUTRUdMzxG5BmHnnDn7fiHq44-_giYeqWM4pkL-BSG9qRStKzWT1-JdZTf5KinO76j5xPVBAA3K-hx4Nj9woDY6QcFCb9d0OBTbw Sep 20 04:51:50.665869 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Id: None Sep 20 04:51:50.665869 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Name: None Sep 20 04:51:50.665869 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Identity-Status: Confirmed Sep 20 04:51:50.665869 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Is-Admin-Project: True Sep 20 04:51:50.665869 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Id: default Sep 20 04:51:50.665869 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Name: Default Sep 20 04:51:50.665869 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Id: abdac4af4fb1444c88e98794c0ba4e5e Sep 20 04:51:50.665869 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Name: tempest-VolumesNegativeTest-285428127 Sep 20 04:51:50.665869 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Role: reader,member Sep 20 04:51:50.665869 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Roles: reader,member Sep 20 04:51:50.667747 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/abdac4af4fb1444c88e98794c0ba4e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/abdac4af4fb1444c88e98794c0ba4e5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_abdac4af4fb1444c88e98794c0ba4e5e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/abdac4af4fb1444c88e98794c0ba4e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 04:51:50.667747 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant: tempest-VolumesNegativeTest-285428127 Sep 20 04:51:50.667747 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Id: abdac4af4fb1444c88e98794c0ba4e5e Sep 20 04:51:50.667747 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Name: tempest-VolumesNegativeTest-285428127 Sep 20 04:51:50.667747 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User: tempest-VolumesNegativeTest-285428127-project Sep 20 04:51:50.667747 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Id: default Sep 20 04:51:50.667747 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Name: Default Sep 20 04:51:50.667747 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Id: e96bedb5a16b4eae8a72fa806fdc7a06 Sep 20 04:51:50.667747 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Name: tempest-VolumesNegativeTest-285428127-project Sep 20 04:51:50.667747 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Sep 20 04:51:50.667747 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-691842085", "metadata": {"Type": "work"}}} Sep 20 04:51:50.667747 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: method: Sep 20 04:51:50.667747 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 20 04:51:50.668814 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-691842085', 'metadata': {'Type': 'work'}}}} Sep 20 04:51:50.668814 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 04:51:50.668814 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:51:50.668814 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 20 04:51:50.668814 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 20 04:51:50.668814 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 20 04:51:50.668814 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise error Sep 20 04:51:50.668814 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 20 04:51:50.668814 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:51:50.668814 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 20 04:51:50.668814 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 20 04:51:50.668814 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:51:50.668814 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 20 04:51:50.668814 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi '#$%' Sep 20 04:51:50.668814 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:51:50.668814 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:51:50.668814 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:51:50.668814 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:51:50.668814 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:51:50.668814 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:51:50.668814 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 04:51:50.668814 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 04:51:50.670389 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 20 04:51:50.670389 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 20 04:51:50.670389 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 04:51:50.670389 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 04:51:50.670389 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 20 04:51:50.670389 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 20 04:51:50.670389 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 20 04:51:50.670389 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 20 04:51:50.670389 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 20 04:51:50.670389 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 20 04:51:50.670389 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 20 04:51:50.670389 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:51:50.670389 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:51:50.670389 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:51:50.670389 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:51:50.670389 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:51:50.670389 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:51:50.670389 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 20 04:51:50.670389 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 20 04:51:50.671884 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 20 04:51:50.671884 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:51:50.678515 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-caf546fe-6267-4395-a512-2dfb626479e5 tempest-VolumesNegativeTest-285428127 tempest-VolumesNegativeTest-285428127-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=126813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 04:51:50.684583 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-caf546fe-6267-4395-a512-2dfb626479e5 tempest-VolumesNegativeTest-285428127 tempest-VolumesNegativeTest-285428127-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.365435 Sep 20 04:51:50.686232 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 2/2] 10.222.0.27 () {60 vars in 1156 bytes} [Tue Sep 20 04:51:50 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 373 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 20 04:51:50.753605 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-fb5b3080-3d78-4a34-9fdb-c9203b466de9 tempest-VolumesGetTestJSON-1589417228 tempest-VolumesGetTestJSON-1589417228-project] Calling method '.version_select at 0x7f2e4b471dc0>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:51:50.985478 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-fb5b3080-3d78-4a34-9fdb-c9203b466de9 tempest-VolumesGetTestJSON-1589417228 tempest-VolumesGetTestJSON-1589417228-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/16e928f0-75a7-4a55-8371-ff8beb52637e" status: 200 len: 353 microversion: 2.1 time: 0.293369 Sep 20 04:51:50.986627 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 3/3] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Sep 20 04:51:50 2022] GET /compute/v2.1/os-volumes/16e928f0-75a7-4a55-8371-ff8beb52637e => generated 353 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:51:50.995197 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-a20208ac-b6b0-47f7-ae54-527371c97d36 tempest-VolumesNegativeTest-285428127 tempest-VolumesNegativeTest-285428127-project] Action: 'create', calling method: .version_select at 0x7f2e4b4ded30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1895348855", "metadata": {"Type": "work"}}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:51:51.005627 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-a20208ac-b6b0-47f7-ae54-527371c97d36 tempest-VolumesNegativeTest-285428127 tempest-VolumesNegativeTest-285428127-project] Request method failure captured: Sep 20 04:51:51.005627 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 20 04:51:51.005627 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept: application/json Sep 20 04:51:51.005627 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept-Encoding: identity Sep 20 04:51:51.005627 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Connection: close Sep 20 04:51:51.005627 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Length: 120 Sep 20 04:51:51.005627 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Type: application/json Sep 20 04:51:51.005627 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Host: 10.222.0.27 Sep 20 04:51:51.005627 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Openstack-System-Scope: None Sep 20 04:51:51.005627 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: User-Agent: python-urllib3/1.26.12 Sep 20 04:51:51.005627 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Auth-Token: gAAAAABjKUbiAK7S_GOF55luEIfZQIUZM8mMdxe_DuHJ6VE_zA_TxS-UF2KFvCH9u0HYCVZA1iqsJuM16E2cUTRUdMzxG5BmHnnDn7fiHq44-_giYeqWM4pkL-BSG9qRStKzWT1-JdZTf5KinO76j5xPVBAA3K-hx4Nj9woDY6QcFCb9d0OBTbw Sep 20 04:51:51.005627 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Id: None Sep 20 04:51:51.005627 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Name: None Sep 20 04:51:51.005627 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Identity-Status: Confirmed Sep 20 04:51:51.005627 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Is-Admin-Project: True Sep 20 04:51:51.005627 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Id: default Sep 20 04:51:51.005627 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Name: Default Sep 20 04:51:51.005627 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Id: abdac4af4fb1444c88e98794c0ba4e5e Sep 20 04:51:51.005627 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Name: tempest-VolumesNegativeTest-285428127 Sep 20 04:51:51.005627 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Role: reader,member Sep 20 04:51:51.005627 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Roles: reader,member Sep 20 04:51:51.006706 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/abdac4af4fb1444c88e98794c0ba4e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/abdac4af4fb1444c88e98794c0ba4e5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_abdac4af4fb1444c88e98794c0ba4e5e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/abdac4af4fb1444c88e98794c0ba4e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 04:51:51.006706 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant: tempest-VolumesNegativeTest-285428127 Sep 20 04:51:51.006706 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Id: abdac4af4fb1444c88e98794c0ba4e5e Sep 20 04:51:51.006706 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Name: tempest-VolumesNegativeTest-285428127 Sep 20 04:51:51.006706 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User: tempest-VolumesNegativeTest-285428127-project Sep 20 04:51:51.006706 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Id: default Sep 20 04:51:51.006706 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Name: Default Sep 20 04:51:51.006706 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Id: e96bedb5a16b4eae8a72fa806fdc7a06 Sep 20 04:51:51.006706 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Name: tempest-VolumesNegativeTest-285428127-project Sep 20 04:51:51.006706 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Sep 20 04:51:51.006706 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1895348855", "metadata": {"Type": "work"}}} Sep 20 04:51:51.006706 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: method: Sep 20 04:51:51.006706 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 20 04:51:51.007398 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1895348855', 'metadata': {'Type': 'work'}}}} Sep 20 04:51:51.007398 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 04:51:51.007398 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:51:51.007398 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 20 04:51:51.007398 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 20 04:51:51.007398 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 20 04:51:51.007398 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise error Sep 20 04:51:51.007398 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 20 04:51:51.007398 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:51:51.007398 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 20 04:51:51.007398 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 20 04:51:51.007398 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:51:51.007398 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 20 04:51:51.007398 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi '0' Sep 20 04:51:51.007398 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:51:51.007398 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:51:51.007398 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:51:51.007398 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:51:51.007398 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:51:51.007398 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:51:51.007398 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 04:51:51.007398 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 04:51:51.008387 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 20 04:51:51.008387 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 20 04:51:51.008387 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 04:51:51.008387 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 04:51:51.008387 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 20 04:51:51.008387 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 20 04:51:51.008387 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 20 04:51:51.008387 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 20 04:51:51.008387 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 20 04:51:51.008387 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 20 04:51:51.008387 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 20 04:51:51.008387 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:51:51.008387 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:51:51.008387 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:51:51.008387 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:51:51.008387 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:51:51.008387 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:51:51.008387 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 20 04:51:51.008387 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 20 04:51:51.009228 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 20 04:51:51.009228 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:51:51.016069 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-a20208ac-b6b0-47f7-ae54-527371c97d36 tempest-VolumesNegativeTest-285428127 tempest-VolumesNegativeTest-285428127-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=126813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 04:51:51.019987 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-a20208ac-b6b0-47f7-ae54-527371c97d36 tempest-VolumesNegativeTest-285428127 tempest-VolumesNegativeTest-285428127-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.030817 Sep 20 04:51:51.024311 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 4/4] 10.222.0.27 () {60 vars in 1156 bytes} [Tue Sep 20 04:51:50 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 20 04:51:51.043237 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-102e7e26-0a63-4f98-b7a8-5a12e29167cb tempest-VolumesGetTestJSON-1589417228 tempest-VolumesGetTestJSON-1589417228-project] Calling method '.version_select at 0x7f2e4b438160>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:51:51.135076 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-8152fdf3-9e20-4966-83e4-aef584562c27 tempest-VolumesSnapshotsTestJSON-1738812212 tempest-VolumesSnapshotsTestJSON-1738812212-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.914329 Sep 20 04:51:51.135889 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 1/5] 10.222.0.27 () {60 vars in 1155 bytes} [Tue Sep 20 04:51:46 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4917 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 20 04:51:51.143515 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-94220767-43a6-4cd7-b3ad-d66c66898a35 tempest-VolumesNegativeTest-285428127 tempest-VolumesNegativeTest-285428127-project] Action: 'create', calling method: .version_select at 0x7f2e4b4e0280>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-669019689", "metadata": {"Type": "work"}}} {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:51:51.163484 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-94220767-43a6-4cd7-b3ad-d66c66898a35 tempest-VolumesNegativeTest-285428127 tempest-VolumesNegativeTest-285428127-project] Request method failure captured: Sep 20 04:51:51.163484 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 20 04:51:51.163484 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: Accept: application/json Sep 20 04:51:51.163484 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: Accept-Encoding: identity Sep 20 04:51:51.163484 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: Connection: close Sep 20 04:51:51.163484 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: Content-Length: 118 Sep 20 04:51:51.163484 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: Content-Type: application/json Sep 20 04:51:51.163484 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: Host: 10.222.0.27 Sep 20 04:51:51.163484 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: Openstack-System-Scope: None Sep 20 04:51:51.163484 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: User-Agent: python-urllib3/1.26.12 Sep 20 04:51:51.163484 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Auth-Token: gAAAAABjKUbiAK7S_GOF55luEIfZQIUZM8mMdxe_DuHJ6VE_zA_TxS-UF2KFvCH9u0HYCVZA1iqsJuM16E2cUTRUdMzxG5BmHnnDn7fiHq44-_giYeqWM4pkL-BSG9qRStKzWT1-JdZTf5KinO76j5xPVBAA3K-hx4Nj9woDY6QcFCb9d0OBTbw Sep 20 04:51:51.163484 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Domain-Id: None Sep 20 04:51:51.163484 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Domain-Name: None Sep 20 04:51:51.163484 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Identity-Status: Confirmed Sep 20 04:51:51.163484 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Is-Admin-Project: True Sep 20 04:51:51.163484 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Project-Domain-Id: default Sep 20 04:51:51.163484 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Project-Domain-Name: Default Sep 20 04:51:51.163484 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Project-Id: abdac4af4fb1444c88e98794c0ba4e5e Sep 20 04:51:51.163484 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Project-Name: tempest-VolumesNegativeTest-285428127 Sep 20 04:51:51.163484 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Role: reader,member Sep 20 04:51:51.163484 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Roles: reader,member Sep 20 04:51:51.164636 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/abdac4af4fb1444c88e98794c0ba4e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/abdac4af4fb1444c88e98794c0ba4e5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_abdac4af4fb1444c88e98794c0ba4e5e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/abdac4af4fb1444c88e98794c0ba4e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 04:51:51.164636 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Tenant: tempest-VolumesNegativeTest-285428127 Sep 20 04:51:51.164636 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Tenant-Id: abdac4af4fb1444c88e98794c0ba4e5e Sep 20 04:51:51.164636 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Tenant-Name: tempest-VolumesNegativeTest-285428127 Sep 20 04:51:51.164636 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-User: tempest-VolumesNegativeTest-285428127-project Sep 20 04:51:51.164636 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-User-Domain-Id: default Sep 20 04:51:51.164636 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-User-Domain-Name: Default Sep 20 04:51:51.164636 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-User-Id: e96bedb5a16b4eae8a72fa806fdc7a06 Sep 20 04:51:51.164636 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-User-Name: tempest-VolumesNegativeTest-285428127-project Sep 20 04:51:51.164636 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: Sep 20 04:51:51.164636 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-669019689", "metadata": {"Type": "work"}}} Sep 20 04:51:51.164636 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: method: Sep 20 04:51:51.164636 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 20 04:51:51.165334 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-669019689', 'metadata': {'Type': 'work'}}}} Sep 20 04:51:51.165334 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 04:51:51.165334 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:51:51.165334 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 20 04:51:51.165334 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 20 04:51:51.165334 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 20 04:51:51.165334 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi raise error Sep 20 04:51:51.165334 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 20 04:51:51.165334 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi Sep 20 04:51:51.165334 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 20 04:51:51.165334 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 20 04:51:51.165334 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi Sep 20 04:51:51.165334 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 20 04:51:51.165334 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi '' Sep 20 04:51:51.165334 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi Sep 20 04:51:51.165334 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:51:51.165334 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi Sep 20 04:51:51.165334 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:51:51.165334 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:51:51.165334 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:51:51.165334 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 04:51:51.165334 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 04:51:51.168876 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 20 04:51:51.168876 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 20 04:51:51.168876 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 04:51:51.168876 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 04:51:51.168876 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 20 04:51:51.168876 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 20 04:51:51.168876 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 20 04:51:51.168876 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 20 04:51:51.168876 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 20 04:51:51.168876 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 20 04:51:51.168876 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 20 04:51:51.168876 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi Sep 20 04:51:51.168876 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:51:51.168876 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi Sep 20 04:51:51.168876 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:51:51.168876 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:51:51.168876 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:51:51.168876 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 20 04:51:51.168876 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 20 04:51:51.169951 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 20 04:51:51.169951 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi Sep 20 04:51:51.171843 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-94220767-43a6-4cd7-b3ad-d66c66898a35 tempest-VolumesNegativeTest-285428127 tempest-VolumesNegativeTest-285428127-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=126814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 04:51:51.173330 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-94220767-43a6-4cd7-b3ad-d66c66898a35 tempest-VolumesNegativeTest-285428127 tempest-VolumesNegativeTest-285428127-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.035907 Sep 20 04:51:51.175038 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 2/6] 10.222.0.27 () {60 vars in 1156 bytes} [Tue Sep 20 04:51:51 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 20 04:51:51.182419 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-7f1487a0-a8b2-47f9-ba57-037ece2c4d86 tempest-VolumesSnapshotsTestJSON-1738812212 tempest-VolumesSnapshotsTestJSON-1738812212-project] Calling method '.version_select at 0x7f2e4b474d30>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:51:51.256124 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-102e7e26-0a63-4f98-b7a8-5a12e29167cb tempest-VolumesGetTestJSON-1589417228 tempest-VolumesGetTestJSON-1589417228-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/16e928f0-75a7-4a55-8371-ff8beb52637e" status: 200 len: 353 microversion: 2.1 time: 0.230439 Sep 20 04:51:51.257115 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 5/7] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Sep 20 04:51:51 2022] GET /compute/v2.1/os-volumes/16e928f0-75a7-4a55-8371-ff8beb52637e => generated 353 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:51:51.262419 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-9dc850b7-9282-469a-b3bd-01232689998f tempest-VolumesNegativeTest-285428127 tempest-VolumesNegativeTest-285428127-project] Calling method '.version_select at 0x7f2e4b438790>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:51:51.364485 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-7f1487a0-a8b2-47f9-ba57-037ece2c4d86 tempest-VolumesSnapshotsTestJSON-1738812212 tempest-VolumesSnapshotsTestJSON-1738812212-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/bd05addc-0dc5-42f0-a826-3d17f24a8f03" status: 200 len: 345 microversion: 2.1 time: 0.188163 Sep 20 04:51:51.366584 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 3/8] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Sep 20 04:51:51 2022] GET /compute/v2.1/os-volumes/bd05addc-0dc5-42f0-a826-3d17f24a8f03 => generated 345 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:51:51.374723 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-59ff60ca-cc24-4552-bb70-fe85db660174 tempest-VolumesGetTestJSON-1589417228 tempest-VolumesGetTestJSON-1589417228-project] Calling method '.version_select at 0x7f2e4b474af0>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:51:51.495059 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.wsgi [None req-9dc850b7-9282-469a-b3bd-01232689998f tempest-VolumesNegativeTest-285428127 tempest-VolumesNegativeTest-285428127-project] HTTP exception thrown: Volume tempest-invalid-823712344 could not be found. Sep 20 04:51:51.501011 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-9dc850b7-9282-469a-b3bd-01232689998f tempest-VolumesNegativeTest-285428127 tempest-VolumesNegativeTest-285428127-project] Request method failure captured: Sep 20 04:51:51.501011 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-823712344 HTTP/1.1 Sep 20 04:51:51.501011 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept: application/json Sep 20 04:51:51.501011 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept-Encoding: identity Sep 20 04:51:51.501011 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Connection: close Sep 20 04:51:51.501011 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Length: 0 Sep 20 04:51:51.501011 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Type: application/json Sep 20 04:51:51.501011 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Host: 10.222.0.27 Sep 20 04:51:51.501011 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Openstack-System-Scope: None Sep 20 04:51:51.501011 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: User-Agent: python-urllib3/1.26.12 Sep 20 04:51:51.501011 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Auth-Token: gAAAAABjKUbiAK7S_GOF55luEIfZQIUZM8mMdxe_DuHJ6VE_zA_TxS-UF2KFvCH9u0HYCVZA1iqsJuM16E2cUTRUdMzxG5BmHnnDn7fiHq44-_giYeqWM4pkL-BSG9qRStKzWT1-JdZTf5KinO76j5xPVBAA3K-hx4Nj9woDY6QcFCb9d0OBTbw Sep 20 04:51:51.501011 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Id: None Sep 20 04:51:51.501011 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Name: None Sep 20 04:51:51.501011 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Identity-Status: Confirmed Sep 20 04:51:51.501011 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Is-Admin-Project: True Sep 20 04:51:51.501011 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Id: default Sep 20 04:51:51.501011 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Name: Default Sep 20 04:51:51.501011 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Id: abdac4af4fb1444c88e98794c0ba4e5e Sep 20 04:51:51.501011 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Name: tempest-VolumesNegativeTest-285428127 Sep 20 04:51:51.501011 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Role: reader,member Sep 20 04:51:51.501011 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Roles: reader,member Sep 20 04:51:51.502039 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/abdac4af4fb1444c88e98794c0ba4e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/abdac4af4fb1444c88e98794c0ba4e5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_abdac4af4fb1444c88e98794c0ba4e5e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/abdac4af4fb1444c88e98794c0ba4e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 04:51:51.502039 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant: tempest-VolumesNegativeTest-285428127 Sep 20 04:51:51.502039 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Id: abdac4af4fb1444c88e98794c0ba4e5e Sep 20 04:51:51.502039 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Name: tempest-VolumesNegativeTest-285428127 Sep 20 04:51:51.502039 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User: tempest-VolumesNegativeTest-285428127-project Sep 20 04:51:51.502039 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Id: default Sep 20 04:51:51.502039 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Name: Default Sep 20 04:51:51.502039 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Id: e96bedb5a16b4eae8a72fa806fdc7a06 Sep 20 04:51:51.502039 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Name: tempest-VolumesNegativeTest-285428127-project Sep 20 04:51:51.502039 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: method: Sep 20 04:51:51.502039 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: exception: Volume tempest-invalid-823712344 could not be found. Sep 20 04:51:51.502039 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: action_args: {'id': 'tempest-invalid-823712344'} Sep 20 04:51:51.502039 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 04:51:51.503095 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:51:51.503095 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 20 04:51:51.503095 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 20 04:51:51.503095 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 20 04:51:51.503095 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 20 04:51:51.503095 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 20 04:51:51.503095 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 20 04:51:51.503095 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 20 04:51:51.503095 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 20 04:51:51.503095 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 20 04:51:51.503095 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 20 04:51:51.503095 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 20 04:51:51.503095 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 20 04:51:51.503095 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 20 04:51:51.503095 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 20 04:51:51.503095 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-823712344 could not be found. (HTTP 404) (Request-ID: req-2a9b7872-0aa0-4931-a2a8-6b5d8ca58984) Sep 20 04:51:51.503095 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:51:51.503095 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:51:51.503095 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:51:51.503962 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:51:51.503962 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 20 04:51:51.503962 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 20 04:51:51.503962 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 20 04:51:51.503962 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 20 04:51:51.503962 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 20 04:51:51.503962 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 20 04:51:51.503962 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 20 04:51:51.503962 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 20 04:51:51.503962 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 20 04:51:51.503962 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 20 04:51:51.503962 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 20 04:51:51.503962 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 20 04:51:51.503962 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 20 04:51:51.503962 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 20 04:51:51.503962 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 20 04:51:51.503962 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 20 04:51:51.503962 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 20 04:51:51.503962 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 20 04:51:51.504995 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 20 04:51:51.504995 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 20 04:51:51.504995 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 20 04:51:51.504995 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 20 04:51:51.504995 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-823712344 could not be found. Sep 20 04:51:51.504995 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:51:51.504995 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:51:51.504995 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:51:51.504995 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:51:51.504995 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:51:51.504995 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:51:51.504995 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 04:51:51.504995 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 04:51:51.504995 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 20 04:51:51.504995 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 20 04:51:51.504995 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 04:51:51.504995 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 04:51:51.504995 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 20 04:51:51.504995 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 04:51:51.504995 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-823712344 could not be found. Sep 20 04:51:51.505991 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:51:51.505991 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:51:51.505991 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:51:51.505991 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:51:51.505991 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:51:51.505991 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:51:51.505991 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 04:51:51.505991 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 04:51:51.505991 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-823712344 could not be found. Sep 20 04:51:51.505991 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:51:51.505991 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-9dc850b7-9282-469a-b3bd-01232689998f tempest-VolumesNegativeTest-285428127 tempest-VolumesNegativeTest-285428127-project] Returning 404 to user: Volume tempest-invalid-823712344 could not be found. {{(pid=126813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 04:51:51.505991 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-9dc850b7-9282-469a-b3bd-01232689998f tempest-VolumesNegativeTest-285428127 tempest-VolumesNegativeTest-285428127-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/tempest-invalid-823712344" status: 404 len: 98 microversion: 2.1 time: 0.244193 Sep 20 04:51:51.505991 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 6/9] 10.222.0.27 () {58 vars in 1215 bytes} [Tue Sep 20 04:51:51 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-823712344 => generated 98 bytes in 245 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 20 04:51:51.519936 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-dbbdb140-0cd0-47a5-9e0d-5dd597ed34d0 tempest-VolumesNegativeTest-285428127 tempest-VolumesNegativeTest-285428127-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003855 Sep 20 04:51:51.520643 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 7/10] 10.222.0.27 () {58 vars in 1140 bytes} [Tue Sep 20 04:51:51 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 20 04:51:51.532816 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-af43f203-f7d1-4aa2-802e-2e34520e6c9f tempest-VolumesNegativeTest-285428127 tempest-VolumesNegativeTest-285428127-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004090 Sep 20 04:51:51.536923 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 8/11] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Sep 20 04:51:51 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 20 04:51:51.545294 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-bde0c950-eb70-4f1f-92c6-1908eb6e3dc9 tempest-VolumesNegativeTest-285428127 tempest-VolumesNegativeTest-285428127-project] Calling method '.version_select at 0x7f2e4b438310>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:51:51.663787 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-59ff60ca-cc24-4552-bb70-fe85db660174 tempest-VolumesGetTestJSON-1589417228 tempest-VolumesGetTestJSON-1589417228-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/16e928f0-75a7-4a55-8371-ff8beb52637e" status: 202 len: 0 microversion: 2.1 time: 0.295180 Sep 20 04:51:51.665245 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 4/12] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Sep 20 04:51:51 2022] DELETE /compute/v2.1/os-volumes/16e928f0-75a7-4a55-8371-ff8beb52637e => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 20 04:51:51.679014 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-4faa8a28-404c-45c1-8ec3-78aeaf42a97d tempest-VolumesGetTestJSON-1589417228 tempest-VolumesGetTestJSON-1589417228-project] Calling method '.version_select at 0x7f2e4b4e0310>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:51:51.719547 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.wsgi [None req-bde0c950-eb70-4f1f-92c6-1908eb6e3dc9 tempest-VolumesNegativeTest-285428127 tempest-VolumesNegativeTest-285428127-project] HTTP exception thrown: Volume b6101983-30fa-4331-a129-238a70042285 could not be found. Sep 20 04:51:51.721512 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-bde0c950-eb70-4f1f-92c6-1908eb6e3dc9 tempest-VolumesNegativeTest-285428127 tempest-VolumesNegativeTest-285428127-project] Request method failure captured: Sep 20 04:51:51.721512 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: request: DELETE /compute/v2.1/os-volumes/b6101983-30fa-4331-a129-238a70042285 HTTP/1.1 Sep 20 04:51:51.721512 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept: application/json Sep 20 04:51:51.721512 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept-Encoding: identity Sep 20 04:51:51.721512 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Connection: close Sep 20 04:51:51.721512 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Length: 0 Sep 20 04:51:51.721512 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Type: application/json Sep 20 04:51:51.721512 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Host: 10.222.0.27 Sep 20 04:51:51.721512 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Openstack-System-Scope: None Sep 20 04:51:51.721512 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: User-Agent: python-urllib3/1.26.12 Sep 20 04:51:51.721512 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Auth-Token: gAAAAABjKUbiAK7S_GOF55luEIfZQIUZM8mMdxe_DuHJ6VE_zA_TxS-UF2KFvCH9u0HYCVZA1iqsJuM16E2cUTRUdMzxG5BmHnnDn7fiHq44-_giYeqWM4pkL-BSG9qRStKzWT1-JdZTf5KinO76j5xPVBAA3K-hx4Nj9woDY6QcFCb9d0OBTbw Sep 20 04:51:51.721512 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Id: None Sep 20 04:51:51.721512 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Name: None Sep 20 04:51:51.721512 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Identity-Status: Confirmed Sep 20 04:51:51.721512 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Is-Admin-Project: True Sep 20 04:51:51.721512 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Id: default Sep 20 04:51:51.721512 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Name: Default Sep 20 04:51:51.721512 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Id: abdac4af4fb1444c88e98794c0ba4e5e Sep 20 04:51:51.721512 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Name: tempest-VolumesNegativeTest-285428127 Sep 20 04:51:51.721512 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Role: reader,member Sep 20 04:51:51.721512 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Roles: reader,member Sep 20 04:51:51.722609 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/abdac4af4fb1444c88e98794c0ba4e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/abdac4af4fb1444c88e98794c0ba4e5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_abdac4af4fb1444c88e98794c0ba4e5e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/abdac4af4fb1444c88e98794c0ba4e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 04:51:51.722609 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant: tempest-VolumesNegativeTest-285428127 Sep 20 04:51:51.722609 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Id: abdac4af4fb1444c88e98794c0ba4e5e Sep 20 04:51:51.722609 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Name: tempest-VolumesNegativeTest-285428127 Sep 20 04:51:51.722609 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User: tempest-VolumesNegativeTest-285428127-project Sep 20 04:51:51.722609 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Id: default Sep 20 04:51:51.722609 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Name: Default Sep 20 04:51:51.722609 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Id: e96bedb5a16b4eae8a72fa806fdc7a06 Sep 20 04:51:51.722609 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Name: tempest-VolumesNegativeTest-285428127-project Sep 20 04:51:51.722609 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: method: Sep 20 04:51:51.722609 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: exception: Volume b6101983-30fa-4331-a129-238a70042285 could not be found. Sep 20 04:51:51.722609 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: action_args: {'id': 'b6101983-30fa-4331-a129-238a70042285'} Sep 20 04:51:51.722609 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 04:51:51.723295 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:51:51.723295 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 20 04:51:51.723295 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 20 04:51:51.723295 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 20 04:51:51.723295 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 20 04:51:51.723295 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 20 04:51:51.723295 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 20 04:51:51.723295 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 20 04:51:51.723295 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 20 04:51:51.723295 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 20 04:51:51.723295 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 20 04:51:51.723295 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 20 04:51:51.723295 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 20 04:51:51.723295 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 20 04:51:51.723295 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 20 04:51:51.723295 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b6101983-30fa-4331-a129-238a70042285 could not be found. (HTTP 404) (Request-ID: req-e8726823-92ea-4cbf-9cd4-83eb0e1bad53) Sep 20 04:51:51.723295 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:51:51.723295 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:51:51.723295 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:51:51.724191 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:51:51.724191 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 20 04:51:51.724191 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 20 04:51:51.724191 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 20 04:51:51.724191 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 20 04:51:51.724191 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 20 04:51:51.724191 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 20 04:51:51.724191 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 20 04:51:51.724191 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 20 04:51:51.724191 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 20 04:51:51.724191 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 20 04:51:51.724191 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 20 04:51:51.724191 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 20 04:51:51.724191 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 20 04:51:51.724191 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 20 04:51:51.724191 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 20 04:51:51.724191 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 20 04:51:51.724191 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 20 04:51:51.724191 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 20 04:51:51.725263 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 20 04:51:51.725263 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 20 04:51:51.725263 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 20 04:51:51.725263 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 20 04:51:51.725263 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b6101983-30fa-4331-a129-238a70042285 could not be found. Sep 20 04:51:51.725263 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:51:51.725263 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:51:51.725263 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:51:51.725263 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:51:51.725263 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:51:51.725263 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:51:51.725263 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 04:51:51.725263 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 04:51:51.725263 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 20 04:51:51.725263 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 20 04:51:51.725263 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 04:51:51.725263 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 04:51:51.725263 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 20 04:51:51.725263 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 04:51:51.726108 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b6101983-30fa-4331-a129-238a70042285 could not be found. Sep 20 04:51:51.726108 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:51:51.726108 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:51:51.726108 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:51:51.726108 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:51:51.726108 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:51:51.726108 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:51:51.726108 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 04:51:51.726108 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 04:51:51.726108 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b6101983-30fa-4331-a129-238a70042285 could not be found. Sep 20 04:51:51.726108 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:51:51.726108 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-bde0c950-eb70-4f1f-92c6-1908eb6e3dc9 tempest-VolumesNegativeTest-285428127 tempest-VolumesNegativeTest-285428127-project] Returning 404 to user: Volume b6101983-30fa-4331-a129-238a70042285 could not be found. {{(pid=126813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 04:51:51.726108 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-bde0c950-eb70-4f1f-92c6-1908eb6e3dc9 tempest-VolumesNegativeTest-285428127 tempest-VolumesNegativeTest-285428127-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/b6101983-30fa-4331-a129-238a70042285" status: 404 len: 109 microversion: 2.1 time: 0.181624 Sep 20 04:51:51.726108 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 9/13] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Sep 20 04:51:51 2022] DELETE /compute/v2.1/os-volumes/b6101983-30fa-4331-a129-238a70042285 => generated 109 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 20 04:51:51.735044 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-eea3ccbe-e65e-496b-bda7-4610a05157bc tempest-VolumesNegativeTest-285428127 tempest-VolumesNegativeTest-285428127-project] Calling method '.version_select at 0x7f2e4b4de310>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:51:51.930084 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-4faa8a28-404c-45c1-8ec3-78aeaf42a97d tempest-VolumesGetTestJSON-1589417228 tempest-VolumesGetTestJSON-1589417228-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/16e928f0-75a7-4a55-8371-ff8beb52637e" status: 200 len: 352 microversion: 2.1 time: 0.258169 Sep 20 04:51:51.931269 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 5/14] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Sep 20 04:51:51 2022] GET /compute/v2.1/os-volumes/16e928f0-75a7-4a55-8371-ff8beb52637e => generated 352 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:51:51.995310 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.wsgi [None req-eea3ccbe-e65e-496b-bda7-4610a05157bc tempest-VolumesNegativeTest-285428127 tempest-VolumesNegativeTest-285428127-project] HTTP exception thrown: Volume c5ed0239-aba6-495c-92c0-cd3147b937e2 could not be found. Sep 20 04:51:51.997455 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-eea3ccbe-e65e-496b-bda7-4610a05157bc tempest-VolumesNegativeTest-285428127 tempest-VolumesNegativeTest-285428127-project] Request method failure captured: Sep 20 04:51:51.997455 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: request: GET /compute/v2.1/os-volumes/c5ed0239-aba6-495c-92c0-cd3147b937e2 HTTP/1.1 Sep 20 04:51:51.997455 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept: application/json Sep 20 04:51:51.997455 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept-Encoding: identity Sep 20 04:51:51.997455 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Connection: close Sep 20 04:51:51.997455 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Length: 0 Sep 20 04:51:51.997455 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Type: application/json Sep 20 04:51:51.997455 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Host: 10.222.0.27 Sep 20 04:51:51.997455 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Openstack-System-Scope: None Sep 20 04:51:51.997455 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: User-Agent: python-urllib3/1.26.12 Sep 20 04:51:51.997455 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Auth-Token: gAAAAABjKUbiAK7S_GOF55luEIfZQIUZM8mMdxe_DuHJ6VE_zA_TxS-UF2KFvCH9u0HYCVZA1iqsJuM16E2cUTRUdMzxG5BmHnnDn7fiHq44-_giYeqWM4pkL-BSG9qRStKzWT1-JdZTf5KinO76j5xPVBAA3K-hx4Nj9woDY6QcFCb9d0OBTbw Sep 20 04:51:51.997455 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Id: None Sep 20 04:51:51.997455 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Name: None Sep 20 04:51:51.997455 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Identity-Status: Confirmed Sep 20 04:51:51.997455 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Is-Admin-Project: True Sep 20 04:51:51.997455 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Id: default Sep 20 04:51:51.997455 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Name: Default Sep 20 04:51:51.997455 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Id: abdac4af4fb1444c88e98794c0ba4e5e Sep 20 04:51:51.997455 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Name: tempest-VolumesNegativeTest-285428127 Sep 20 04:51:51.997455 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Role: reader,member Sep 20 04:51:51.997455 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Roles: reader,member Sep 20 04:51:51.998491 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/abdac4af4fb1444c88e98794c0ba4e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/abdac4af4fb1444c88e98794c0ba4e5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_abdac4af4fb1444c88e98794c0ba4e5e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/abdac4af4fb1444c88e98794c0ba4e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 04:51:51.998491 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant: tempest-VolumesNegativeTest-285428127 Sep 20 04:51:51.998491 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Id: abdac4af4fb1444c88e98794c0ba4e5e Sep 20 04:51:51.998491 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Name: tempest-VolumesNegativeTest-285428127 Sep 20 04:51:51.998491 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User: tempest-VolumesNegativeTest-285428127-project Sep 20 04:51:51.998491 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Id: default Sep 20 04:51:51.998491 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Name: Default Sep 20 04:51:51.998491 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Id: e96bedb5a16b4eae8a72fa806fdc7a06 Sep 20 04:51:51.998491 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Name: tempest-VolumesNegativeTest-285428127-project Sep 20 04:51:51.998491 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: method: Sep 20 04:51:51.998491 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: exception: Volume c5ed0239-aba6-495c-92c0-cd3147b937e2 could not be found. Sep 20 04:51:51.998491 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: action_args: {'id': 'c5ed0239-aba6-495c-92c0-cd3147b937e2'} Sep 20 04:51:51.998491 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 04:51:51.999096 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:51:51.999096 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 20 04:51:51.999096 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 20 04:51:51.999096 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 20 04:51:51.999096 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 20 04:51:51.999096 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 20 04:51:51.999096 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 20 04:51:51.999096 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 20 04:51:51.999096 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 20 04:51:51.999096 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 20 04:51:51.999096 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 20 04:51:51.999096 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 20 04:51:51.999096 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 20 04:51:51.999096 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 20 04:51:51.999096 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 20 04:51:51.999096 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c5ed0239-aba6-495c-92c0-cd3147b937e2 could not be found. (HTTP 404) (Request-ID: req-7de6fc32-3a83-4d86-bf54-627db3cad964) Sep 20 04:51:51.999096 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:51:51.999096 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:51:51.999096 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:51:52.000061 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:51:52.000061 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 20 04:51:52.000061 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 20 04:51:52.000061 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 20 04:51:52.000061 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 20 04:51:52.000061 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 20 04:51:52.000061 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 20 04:51:52.000061 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 20 04:51:52.000061 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 20 04:51:52.000061 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 20 04:51:52.000061 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 20 04:51:52.000061 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 20 04:51:52.000061 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 20 04:51:52.000061 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 20 04:51:52.000061 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 20 04:51:52.000061 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 20 04:51:52.000061 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 20 04:51:52.000061 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 20 04:51:52.000061 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 20 04:51:52.005944 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 20 04:51:52.005944 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 20 04:51:52.005944 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 20 04:51:52.005944 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 20 04:51:52.005944 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c5ed0239-aba6-495c-92c0-cd3147b937e2 could not be found. Sep 20 04:51:52.005944 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:51:52.005944 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:51:52.005944 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:51:52.005944 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:51:52.005944 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:51:52.005944 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:51:52.005944 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 04:51:52.005944 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 04:51:52.005944 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 20 04:51:52.005944 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 20 04:51:52.005944 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 04:51:52.005944 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 04:51:52.005944 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 20 04:51:52.005944 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 04:51:52.006830 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c5ed0239-aba6-495c-92c0-cd3147b937e2 could not be found. Sep 20 04:51:52.006830 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:51:52.006830 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:51:52.006830 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:51:52.006830 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:51:52.006830 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:51:52.006830 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:51:52.006830 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 04:51:52.006830 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 04:51:52.006830 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c5ed0239-aba6-495c-92c0-cd3147b937e2 could not be found. Sep 20 04:51:52.006830 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:51:52.006830 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-eea3ccbe-e65e-496b-bda7-4610a05157bc tempest-VolumesNegativeTest-285428127 tempest-VolumesNegativeTest-285428127-project] Returning 404 to user: Volume c5ed0239-aba6-495c-92c0-cd3147b937e2 could not be found. {{(pid=126813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 04:51:52.006830 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-eea3ccbe-e65e-496b-bda7-4610a05157bc tempest-VolumesNegativeTest-285428127 tempest-VolumesNegativeTest-285428127-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/c5ed0239-aba6-495c-92c0-cd3147b937e2" status: 404 len: 109 microversion: 2.1 time: 0.267684 Sep 20 04:51:52.006830 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 10/15] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Sep 20 04:51:51 2022] GET /compute/v2.1/os-volumes/c5ed0239-aba6-495c-92c0-cd3147b937e2 => generated 109 bytes in 269 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 20 04:51:52.383334 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-cc636784-fa76-4468-b6ab-1dac9c6bdf07 tempest-VolumesSnapshotsTestJSON-1738812212 tempest-VolumesSnapshotsTestJSON-1738812212-project] Calling method '.version_select at 0x7f2e4b4e09d0>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:51:52.501489 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-cc636784-fa76-4468-b6ab-1dac9c6bdf07 tempest-VolumesSnapshotsTestJSON-1738812212 tempest-VolumesSnapshotsTestJSON-1738812212-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/bd05addc-0dc5-42f0-a826-3d17f24a8f03" status: 200 len: 346 microversion: 2.1 time: 0.124427 Sep 20 04:51:52.503898 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 6/16] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Sep 20 04:51:52 2022] GET /compute/v2.1/os-volumes/bd05addc-0dc5-42f0-a826-3d17f24a8f03 => generated 346 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:51:52.518661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-5cec7849-1b75-4ad7-af92-8df953f8a178 tempest-VolumesSnapshotsTestJSON-1738812212 tempest-VolumesSnapshotsTestJSON-1738812212-project] Action: 'create', calling method: .version_select at 0x7f2e4b4de430>, body: {"snapshot": {"volume_id": "bd05addc-0dc5-42f0-a826-3d17f24a8f03", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1619492984"}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:51:53.004783 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-5cec7849-1b75-4ad7-af92-8df953f8a178 tempest-VolumesSnapshotsTestJSON-1738812212 tempest-VolumesSnapshotsTestJSON-1738812212-project] 10.222.0.27 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.490510 Sep 20 04:51:53.011363 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 11/17] 10.222.0.27 () {60 vars in 1162 bytes} [Tue Sep 20 04:51:52 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:51:53.011363 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-35b81c48-58f1-470e-9626-af52ebe08702 tempest-VolumesGetTestJSON-1589417228 tempest-VolumesGetTestJSON-1589417228-project] Calling method '.version_select at 0x7f2e4b438dc0>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:51:53.141898 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.wsgi [None req-35b81c48-58f1-470e-9626-af52ebe08702 tempest-VolumesGetTestJSON-1589417228 tempest-VolumesGetTestJSON-1589417228-project] HTTP exception thrown: Volume 16e928f0-75a7-4a55-8371-ff8beb52637e could not be found. Sep 20 04:51:53.143902 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-35b81c48-58f1-470e-9626-af52ebe08702 tempest-VolumesGetTestJSON-1589417228 tempest-VolumesGetTestJSON-1589417228-project] Request method failure captured: Sep 20 04:51:53.143902 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: request: GET /compute/v2.1/os-volumes/16e928f0-75a7-4a55-8371-ff8beb52637e HTTP/1.1 Sep 20 04:51:53.143902 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept: application/json Sep 20 04:51:53.143902 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept-Encoding: identity Sep 20 04:51:53.143902 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Connection: close Sep 20 04:51:53.143902 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Length: 0 Sep 20 04:51:53.143902 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Type: application/json Sep 20 04:51:53.143902 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Host: 10.222.0.27 Sep 20 04:51:53.143902 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Openstack-System-Scope: None Sep 20 04:51:53.143902 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: User-Agent: python-urllib3/1.26.12 Sep 20 04:51:53.143902 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Auth-Token: gAAAAABjKUbhSVpVc68OTT8Ro3ySwQ39tgw7BSQyEGq6yaJbYY-yFgRMfBB4EbnkpmOglbGSQ3qCvsTaXQR_D2XgjJL3of9ed_Otp-vdnhUHhz8PoTm5vbWWlFqyQrE6mQxf33JwbJiP4ZPhx2IustRcuYC6UXcrE2pgLVfs6tY6GFA-XdXxY-Y Sep 20 04:51:53.143902 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Id: None Sep 20 04:51:53.143902 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Name: None Sep 20 04:51:53.143902 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Identity-Status: Confirmed Sep 20 04:51:53.143902 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Is-Admin-Project: True Sep 20 04:51:53.143902 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Id: default Sep 20 04:51:53.143902 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Name: Default Sep 20 04:51:53.143902 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Id: 87da630024cd4832ac7b09e5845a3d05 Sep 20 04:51:53.143902 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Name: tempest-VolumesGetTestJSON-1589417228 Sep 20 04:51:53.143902 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Role: reader,member Sep 20 04:51:53.143902 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Roles: reader,member Sep 20 04:51:53.145080 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/87da630024cd4832ac7b09e5845a3d05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/87da630024cd4832ac7b09e5845a3d05"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_87da630024cd4832ac7b09e5845a3d05", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/87da630024cd4832ac7b09e5845a3d05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 04:51:53.145080 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant: tempest-VolumesGetTestJSON-1589417228 Sep 20 04:51:53.145080 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Id: 87da630024cd4832ac7b09e5845a3d05 Sep 20 04:51:53.145080 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Name: tempest-VolumesGetTestJSON-1589417228 Sep 20 04:51:53.145080 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User: tempest-VolumesGetTestJSON-1589417228-project Sep 20 04:51:53.145080 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Id: default Sep 20 04:51:53.145080 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Name: Default Sep 20 04:51:53.145080 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Id: 3dd9016e10cd489caaf388defe62beac Sep 20 04:51:53.145080 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Name: tempest-VolumesGetTestJSON-1589417228-project Sep 20 04:51:53.145080 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: method: Sep 20 04:51:53.145080 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: exception: Volume 16e928f0-75a7-4a55-8371-ff8beb52637e could not be found. Sep 20 04:51:53.145080 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: action_args: {'id': '16e928f0-75a7-4a55-8371-ff8beb52637e'} Sep 20 04:51:53.145080 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 04:51:53.146047 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:51:53.146047 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 20 04:51:53.146047 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 20 04:51:53.146047 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 20 04:51:53.146047 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 20 04:51:53.146047 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 20 04:51:53.146047 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 20 04:51:53.146047 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 20 04:51:53.146047 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 20 04:51:53.146047 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 20 04:51:53.146047 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 20 04:51:53.146047 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 20 04:51:53.146047 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 20 04:51:53.146047 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 20 04:51:53.146047 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 20 04:51:53.146047 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 16e928f0-75a7-4a55-8371-ff8beb52637e could not be found. (HTTP 404) (Request-ID: req-0b2d6dd0-f1b7-4991-a3d9-d1c7f42829b4) Sep 20 04:51:53.146047 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:51:53.146047 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:51:53.146047 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:51:53.146983 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:51:53.146983 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 20 04:51:53.146983 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 20 04:51:53.146983 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 20 04:51:53.146983 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 20 04:51:53.146983 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 20 04:51:53.146983 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 20 04:51:53.146983 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 20 04:51:53.146983 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 20 04:51:53.146983 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 20 04:51:53.146983 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 20 04:51:53.146983 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 20 04:51:53.146983 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 20 04:51:53.146983 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 20 04:51:53.146983 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 20 04:51:53.146983 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 20 04:51:53.146983 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 20 04:51:53.146983 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 20 04:51:53.146983 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 20 04:51:53.147900 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 20 04:51:53.147900 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 20 04:51:53.147900 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 20 04:51:53.147900 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 20 04:51:53.147900 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 16e928f0-75a7-4a55-8371-ff8beb52637e could not be found. Sep 20 04:51:53.147900 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:51:53.147900 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:51:53.147900 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:51:53.147900 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:51:53.147900 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:51:53.147900 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:51:53.147900 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 04:51:53.147900 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 04:51:53.147900 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 20 04:51:53.147900 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 20 04:51:53.147900 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 04:51:53.147900 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 04:51:53.147900 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 20 04:51:53.147900 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 04:51:53.148973 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 16e928f0-75a7-4a55-8371-ff8beb52637e could not be found. Sep 20 04:51:53.148973 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:51:53.148973 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:51:53.148973 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:51:53.148973 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:51:53.148973 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:51:53.148973 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:51:53.148973 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 04:51:53.148973 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 04:51:53.148973 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 16e928f0-75a7-4a55-8371-ff8beb52637e could not be found. Sep 20 04:51:53.148973 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:51:53.148973 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-35b81c48-58f1-470e-9626-af52ebe08702 tempest-VolumesGetTestJSON-1589417228 tempest-VolumesGetTestJSON-1589417228-project] Returning 404 to user: Volume 16e928f0-75a7-4a55-8371-ff8beb52637e could not be found. {{(pid=126813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 04:51:53.148973 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-35b81c48-58f1-470e-9626-af52ebe08702 tempest-VolumesGetTestJSON-1589417228 tempest-VolumesGetTestJSON-1589417228-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/16e928f0-75a7-4a55-8371-ff8beb52637e" status: 404 len: 109 microversion: 2.1 time: 0.138472 Sep 20 04:51:53.148973 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 12/18] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Sep 20 04:51:53 2022] GET /compute/v2.1/os-volumes/16e928f0-75a7-4a55-8371-ff8beb52637e => generated 109 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 20 04:51:53.155890 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-c7381030-5fdb-4dc5-b3f1-cfd1df1e18a2 tempest-VolumesSnapshotsTestJSON-1738812212 tempest-VolumesSnapshotsTestJSON-1738812212-project] Calling method '.version_select at 0x7f2e4b431af0>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:51:53.212194 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-0e28c516-7ad1-4ea2-95fb-3d137cb8a50f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-479739097", "imageRef": "080ea053-830e-4470-a886-0ab99b0ab3e0", "flavorRef": "452", "networks": [{"uuid": "75e666c4-550f-4bd9-83b7-8b3fdbe9a8ca"}]}} {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:51:53.280389 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-c7381030-5fdb-4dc5-b3f1-cfd1df1e18a2 tempest-VolumesSnapshotsTestJSON-1738812212 tempest-VolumesSnapshotsTestJSON-1738812212-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/b8011ad0-b4fc-4b2d-890b-75b4ea420ead" status: 200 len: 287 microversion: 2.1 time: 0.132866 Sep 20 04:51:53.286956 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 13/19] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Sep 20 04:51:53 2022] GET /compute/v2.1/os-snapshots/b8011ad0-b4fc-4b2d-890b-75b4ea420ead => generated 287 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:51:53.294648 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-8685f040-6e66-47e9-841b-6ec91eae728e tempest-VolumesSnapshotsTestJSON-1738812212 tempest-VolumesSnapshotsTestJSON-1738812212-project] Calling method '.version_select at 0x7f2e4b438ca0>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:51:53.506391 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.network.neutron [None req-0e28c516-7ad1-4ea2-95fb-3d137cb8a50f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] validate_networks() for [('75e666c4-550f-4bd9-83b7-8b3fdbe9a8ca', None, None, None, None, None)] {{(pid=126814) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 20 04:51:53.552089 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-8685f040-6e66-47e9-841b-6ec91eae728e tempest-VolumesSnapshotsTestJSON-1738812212 tempest-VolumesSnapshotsTestJSON-1738812212-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.261574 Sep 20 04:51:53.552782 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 14/20] 10.222.0.27 () {58 vars in 1140 bytes} [Tue Sep 20 04:51:53 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:51:53.565745 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-23f972b4-2e4f-4a7d-a1d3-3720324e4fe5 tempest-VolumesSnapshotsTestJSON-1738812212 tempest-VolumesSnapshotsTestJSON-1738812212-project] Calling method '.version_select at 0x7f2e4b4deca0>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:51:53.953737 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-23f972b4-2e4f-4a7d-a1d3-3720324e4fe5 tempest-VolumesSnapshotsTestJSON-1738812212 tempest-VolumesSnapshotsTestJSON-1738812212-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/b8011ad0-b4fc-4b2d-890b-75b4ea420ead" status: 200 len: 287 microversion: 2.1 time: 0.392024 Sep 20 04:51:53.954869 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 15/21] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Sep 20 04:51:53 2022] GET /compute/v2.1/os-snapshots/b8011ad0-b4fc-4b2d-890b-75b4ea420ead => generated 287 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 04:51:54.902977 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.virt.hardware [None req-0e28c516-7ad1-4ea2-95fb-3d137cb8a50f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Flavor limits 0:0:0 {{(pid=126814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 20 04:51:54.904941 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.virt.hardware [None req-0e28c516-7ad1-4ea2-95fb-3d137cb8a50f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Image limits 0:0:0 {{(pid=126814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 20 04:51:54.907891 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.virt.hardware [None req-0e28c516-7ad1-4ea2-95fb-3d137cb8a50f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Flavor pref 0:0:0 {{(pid=126814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 20 04:51:54.909298 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.virt.hardware [None req-0e28c516-7ad1-4ea2-95fb-3d137cb8a50f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Image pref 0:0:0 {{(pid=126814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 20 04:51:54.910823 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.virt.hardware [None req-0e28c516-7ad1-4ea2-95fb-3d137cb8a50f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 20 04:51:54.950071 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-0e28c516-7ad1-4ea2-95fb-3d137cb8a50f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:51:54.951881 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-0e28c516-7ad1-4ea2-95fb-3d137cb8a50f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:51:54.952533 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-0e28c516-7ad1-4ea2-95fb-3d137cb8a50f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:51:54.955064 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-0e28c516-7ad1-4ea2-95fb-3d137cb8a50f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:51:54.956345 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-0e28c516-7ad1-4ea2-95fb-3d137cb8a50f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:51:54.957111 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-0e28c516-7ad1-4ea2-95fb-3d137cb8a50f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:51:54.966905 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-213d9939-3e20-4c42-a356-be1ebbf9d673 tempest-VolumesSnapshotsTestJSON-1738812212 tempest-VolumesSnapshotsTestJSON-1738812212-project] Calling method '.version_select at 0x7f2e4b431790>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:51:55.027661 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.quota [None req-0e28c516-7ad1-4ea2-95fb-3d137cb8a50f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Getting quotas for project 72aa7ea3cb69454797bd7956e12f2a5e. Resources: {'ram', 'cores', 'instances'} {{(pid=126814) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 04:51:55.037799 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-213d9939-3e20-4c42-a356-be1ebbf9d673 tempest-VolumesSnapshotsTestJSON-1738812212 tempest-VolumesSnapshotsTestJSON-1738812212-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/b8011ad0-b4fc-4b2d-890b-75b4ea420ead" status: 200 len: 287 microversion: 2.1 time: 0.075023 Sep 20 04:51:55.038368 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 16/22] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Sep 20 04:51:54 2022] GET /compute/v2.1/os-snapshots/b8011ad0-b4fc-4b2d-890b-75b4ea420ead => generated 287 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 04:51:55.039636 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.quota [None req-0e28c516-7ad1-4ea2-95fb-3d137cb8a50f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Getting quotas for user 3a77211762af4cc9b4f0a2f74ac3ae1d and project 72aa7ea3cb69454797bd7956e12f2a5e. Resources: {'ram', 'cores', 'instances'} {{(pid=126814) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 04:51:55.058638 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-0e28c516-7ad1-4ea2-95fb-3d137cb8a50f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Going to run 1 instances... {{(pid=126814) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 20 04:51:55.066536 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-0e28c516-7ad1-4ea2-95fb-3d137cb8a50f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] [instance: 033b2f0d-760f-467a-9b3b-e7a8f2196aa7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='080ea053-830e-4470-a886-0ab99b0ab3e0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126814) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 20 04:51:55.219774 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-0e28c516-7ad1-4ea2-95fb-3d137cb8a50f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.318155 Sep 20 04:51:55.220971 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 7/23] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Sep 20 04:51:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2320 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 20 04:51:55.233366 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-f2bebb62-ffe5-49a1-8e42-efffa3d52eb8 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:51:55.234257 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-f2bebb62-ffe5-49a1-8e42-efffa3d52eb8 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] [instance: 033b2f0d-760f-467a-9b3b-e7a8f2196aa7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:51:55.444352 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-f2bebb62-ffe5-49a1-8e42-efffa3d52eb8 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77211762af4cc9b4f0a2f74ac3ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa7ea3cb69454797bd7956e12f2a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:51:55.469883 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-f2bebb62-ffe5-49a1-8e42-efffa3d52eb8 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] 10.222.0.27 "GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7" status: 200 len: 1214 microversion: 2.1 time: 0.240802 Sep 20 04:51:55.470458 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 17/24] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:51:55 2022] GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7 => generated 1214 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:51:56.052579 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-46248bdb-04d0-447f-b2bb-613cba62e369 tempest-VolumesSnapshotsTestJSON-1738812212 tempest-VolumesSnapshotsTestJSON-1738812212-project] Calling method '.version_select at 0x7f2e4ab31af0>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:51:56.160304 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-46248bdb-04d0-447f-b2bb-613cba62e369 tempest-VolumesSnapshotsTestJSON-1738812212 tempest-VolumesSnapshotsTestJSON-1738812212-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/b8011ad0-b4fc-4b2d-890b-75b4ea420ead" status: 200 len: 287 microversion: 2.1 time: 0.112709 Sep 20 04:51:56.165331 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 8/25] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Sep 20 04:51:56 2022] GET /compute/v2.1/os-snapshots/b8011ad0-b4fc-4b2d-890b-75b4ea420ead => generated 287 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:51:56.497970 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-3f653203-f167-48e8-8e7e-e40392f544cf tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:51:56.501427 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-3f653203-f167-48e8-8e7e-e40392f544cf tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] [instance: 033b2f0d-760f-467a-9b3b-e7a8f2196aa7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:51:57.160928 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-3f653203-f167-48e8-8e7e-e40392f544cf tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77211762af4cc9b4f0a2f74ac3ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa7ea3cb69454797bd7956e12f2a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:51:57.173666 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-cbfbb1ce-d323-4a09-b793-b887c850f11f tempest-VolumesSnapshotsTestJSON-1738812212 tempest-VolumesSnapshotsTestJSON-1738812212-project] Calling method '.version_select at 0x7f2e4ab4f280>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:51:57.175532 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-3f653203-f167-48e8-8e7e-e40392f544cf tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] 10.222.0.27 "GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7" status: 200 len: 1214 microversion: 2.1 time: 0.679857 Sep 20 04:51:57.178133 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 18/26] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:51:56 2022] GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7 => generated 1214 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:51:57.250703 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-cbfbb1ce-d323-4a09-b793-b887c850f11f tempest-VolumesSnapshotsTestJSON-1738812212 tempest-VolumesSnapshotsTestJSON-1738812212-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/b8011ad0-b4fc-4b2d-890b-75b4ea420ead" status: 200 len: 288 microversion: 2.1 time: 0.081431 Sep 20 04:51:57.252430 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 9/27] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Sep 20 04:51:57 2022] GET /compute/v2.1/os-snapshots/b8011ad0-b4fc-4b2d-890b-75b4ea420ead => generated 288 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 04:51:57.263264 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-cc43c863-adf3-4242-8c89-500dd99b04eb tempest-VolumesSnapshotsTestJSON-1738812212 tempest-VolumesSnapshotsTestJSON-1738812212-project] Calling method '.version_select at 0x7f2e4b42f1f0>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:51:57.717089 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-cc43c863-adf3-4242-8c89-500dd99b04eb tempest-VolumesSnapshotsTestJSON-1738812212 tempest-VolumesSnapshotsTestJSON-1738812212-project] 10.222.0.27 "DELETE /compute/v2.1/os-snapshots/b8011ad0-b4fc-4b2d-890b-75b4ea420ead" status: 202 len: 0 microversion: 2.1 time: 0.458151 Sep 20 04:51:57.725807 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 19/28] 10.222.0.27 () {58 vars in 1254 bytes} [Tue Sep 20 04:51:57 2022] DELETE /compute/v2.1/os-snapshots/b8011ad0-b4fc-4b2d-890b-75b4ea420ead => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 20 04:51:57.727734 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-e9b2aee8-5ce6-4429-9ddd-8d0ecf4f13ac tempest-VolumesSnapshotsTestJSON-1738812212 tempest-VolumesSnapshotsTestJSON-1738812212-project] Calling method '.version_select at 0x7f2e4ab4f940>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:51:58.057421 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.wsgi [None req-e9b2aee8-5ce6-4429-9ddd-8d0ecf4f13ac tempest-VolumesSnapshotsTestJSON-1738812212 tempest-VolumesSnapshotsTestJSON-1738812212-project] HTTP exception thrown: Snapshot b8011ad0-b4fc-4b2d-890b-75b4ea420ead could not be found. Sep 20 04:51:58.064042 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-e9b2aee8-5ce6-4429-9ddd-8d0ecf4f13ac tempest-VolumesSnapshotsTestJSON-1738812212 tempest-VolumesSnapshotsTestJSON-1738812212-project] Request method failure captured: Sep 20 04:51:58.064042 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: request: GET /compute/v2.1/os-snapshots/b8011ad0-b4fc-4b2d-890b-75b4ea420ead HTTP/1.1 Sep 20 04:51:58.064042 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: Accept: application/json Sep 20 04:51:58.064042 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: Accept-Encoding: identity Sep 20 04:51:58.064042 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: Connection: close Sep 20 04:51:58.064042 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: Content-Length: 0 Sep 20 04:51:58.064042 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: Content-Type: application/json Sep 20 04:51:58.064042 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: Host: 10.222.0.27 Sep 20 04:51:58.064042 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: Openstack-System-Scope: None Sep 20 04:51:58.064042 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: User-Agent: python-urllib3/1.26.12 Sep 20 04:51:58.064042 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Auth-Token: gAAAAABjKUbiaqowVZKUKvwe-FtRO48IgGJ_3UAr10rvWX3q1gnaD2G4mQyI9MbqK4rpabQ17rcTg41eQsKFBbqB31fppMERUhOSZLltKyxHOcW3w0ryB3adrvlQmStnIsBfXURHwCk8I6pKsG0LBByPCLmfBM4Sgz6bqSU-wS3h3CUly4umhl0 Sep 20 04:51:58.064042 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Domain-Id: None Sep 20 04:51:58.064042 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Domain-Name: None Sep 20 04:51:58.064042 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Identity-Status: Confirmed Sep 20 04:51:58.064042 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Is-Admin-Project: True Sep 20 04:51:58.064042 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Project-Domain-Id: default Sep 20 04:51:58.064042 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Project-Domain-Name: Default Sep 20 04:51:58.064042 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Project-Id: c2376275534c4c0bb4d279a625a1bdcd Sep 20 04:51:58.064042 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1738812212 Sep 20 04:51:58.064042 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Role: reader,member Sep 20 04:51:58.064042 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Roles: reader,member Sep 20 04:51:58.065283 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c2376275534c4c0bb4d279a625a1bdcd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c2376275534c4c0bb4d279a625a1bdcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c2376275534c4c0bb4d279a625a1bdcd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c2376275534c4c0bb4d279a625a1bdcd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 04:51:58.065283 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1738812212 Sep 20 04:51:58.065283 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Tenant-Id: c2376275534c4c0bb4d279a625a1bdcd Sep 20 04:51:58.065283 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1738812212 Sep 20 04:51:58.065283 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-User: tempest-VolumesSnapshotsTestJSON-1738812212-project Sep 20 04:51:58.065283 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-User-Domain-Id: default Sep 20 04:51:58.065283 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-User-Domain-Name: Default Sep 20 04:51:58.065283 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-User-Id: 83fd4adb347749a1ba1df6bf78e19118 Sep 20 04:51:58.065283 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1738812212-project Sep 20 04:51:58.065283 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: method: Sep 20 04:51:58.065283 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: exception: Snapshot b8011ad0-b4fc-4b2d-890b-75b4ea420ead could not be found. Sep 20 04:51:58.065283 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: action_args: {'id': 'b8011ad0-b4fc-4b2d-890b-75b4ea420ead'} Sep 20 04:51:58.065283 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 04:51:58.066017 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:51:58.066017 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 20 04:51:58.066017 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 20 04:51:58.066017 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 20 04:51:58.066017 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 20 04:51:58.066017 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 20 04:51:58.066017 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 20 04:51:58.066017 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 20 04:51:58.066017 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 20 04:51:58.066017 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 20 04:51:58.066017 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 20 04:51:58.066017 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 20 04:51:58.066017 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 20 04:51:58.066017 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 20 04:51:58.066017 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 20 04:51:58.066017 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot b8011ad0-b4fc-4b2d-890b-75b4ea420ead could not be found. (HTTP 404) (Request-ID: req-2b331456-6810-4a4f-8429-6e3a9fa6b1d1) Sep 20 04:51:58.066017 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi Sep 20 04:51:58.066017 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:51:58.066951 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi Sep 20 04:51:58.066951 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:51:58.066951 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 20 04:51:58.066951 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 20 04:51:58.066951 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 20 04:51:58.066951 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 20 04:51:58.066951 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 20 04:51:58.066951 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 20 04:51:58.066951 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 20 04:51:58.066951 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 20 04:51:58.066951 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 20 04:51:58.066951 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 20 04:51:58.066951 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 20 04:51:58.066951 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 20 04:51:58.066951 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 20 04:51:58.066951 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 20 04:51:58.066951 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 20 04:51:58.066951 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 20 04:51:58.066951 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 20 04:51:58.067906 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 20 04:51:58.067906 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 20 04:51:58.067906 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 20 04:51:58.067906 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 20 04:51:58.067906 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 20 04:51:58.067906 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot b8011ad0-b4fc-4b2d-890b-75b4ea420ead could not be found. Sep 20 04:51:58.067906 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi Sep 20 04:51:58.067906 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:51:58.067906 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi Sep 20 04:51:58.067906 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:51:58.067906 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:51:58.067906 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:51:58.067906 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 04:51:58.067906 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 04:51:58.067906 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 20 04:51:58.067906 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 20 04:51:58.067906 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 04:51:58.067906 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 04:51:58.067906 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 20 04:51:58.067906 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 04:51:58.068904 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot b8011ad0-b4fc-4b2d-890b-75b4ea420ead could not be found. Sep 20 04:51:58.068904 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi Sep 20 04:51:58.068904 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:51:58.068904 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi Sep 20 04:51:58.068904 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:51:58.068904 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:51:58.068904 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:51:58.068904 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 04:51:58.068904 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 04:51:58.068904 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot b8011ad0-b4fc-4b2d-890b-75b4ea420ead could not be found. Sep 20 04:51:58.068904 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi Sep 20 04:51:58.068904 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-e9b2aee8-5ce6-4429-9ddd-8d0ecf4f13ac tempest-VolumesSnapshotsTestJSON-1738812212 tempest-VolumesSnapshotsTestJSON-1738812212-project] Returning 404 to user: Snapshot b8011ad0-b4fc-4b2d-890b-75b4ea420ead could not be found. {{(pid=126814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 04:51:58.068904 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-e9b2aee8-5ce6-4429-9ddd-8d0ecf4f13ac tempest-VolumesSnapshotsTestJSON-1738812212 tempest-VolumesSnapshotsTestJSON-1738812212-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/b8011ad0-b4fc-4b2d-890b-75b4ea420ead" status: 404 len: 111 microversion: 2.1 time: 0.342786 Sep 20 04:51:58.074921 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-0c9ac5f9-e5df-4648-86f6-0fe3a0874e75 tempest-VolumesSnapshotsTestJSON-1738812212 tempest-VolumesSnapshotsTestJSON-1738812212-project] Calling method '.version_select at 0x7f2e4b42f700>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:51:58.079519 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 10/29] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Sep 20 04:51:57 2022] GET /compute/v2.1/os-snapshots/b8011ad0-b4fc-4b2d-890b-75b4ea420ead => generated 111 bytes in 348 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 20 04:51:58.206776 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-30e0a633-f853-46f2-b18b-e9f50f1ee9a4 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:51:58.208117 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-30e0a633-f853-46f2-b18b-e9f50f1ee9a4 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] [instance: 033b2f0d-760f-467a-9b3b-e7a8f2196aa7] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:51:58.289407 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-30e0a633-f853-46f2-b18b-e9f50f1ee9a4 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:51:58.290489 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-30e0a633-f853-46f2-b18b-e9f50f1ee9a4 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:51:58.290489 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-30e0a633-f853-46f2-b18b-e9f50f1ee9a4 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:51:58.291241 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-30e0a633-f853-46f2-b18b-e9f50f1ee9a4 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:51:58.295743 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-30e0a633-f853-46f2-b18b-e9f50f1ee9a4 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:51:58.298094 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-30e0a633-f853-46f2-b18b-e9f50f1ee9a4 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:51:59.018002 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-30e0a633-f853-46f2-b18b-e9f50f1ee9a4 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77211762af4cc9b4f0a2f74ac3ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa7ea3cb69454797bd7956e12f2a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:51:59.058747 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-0c9ac5f9-e5df-4648-86f6-0fe3a0874e75 tempest-VolumesSnapshotsTestJSON-1738812212 tempest-VolumesSnapshotsTestJSON-1738812212-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/bd05addc-0dc5-42f0-a826-3d17f24a8f03" status: 202 len: 0 microversion: 2.1 time: 0.987819 Sep 20 04:51:59.059797 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-30e0a633-f853-46f2-b18b-e9f50f1ee9a4 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] 10.222.0.27 "GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7" status: 200 len: 1266 microversion: 2.1 time: 0.858132 Sep 20 04:51:59.060796 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 20/30] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Sep 20 04:51:58 2022] DELETE /compute/v2.1/os-volumes/bd05addc-0dc5-42f0-a826-3d17f24a8f03 => generated 0 bytes in 990 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 20 04:51:59.082321 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-a1fa172b-ef6e-49bc-a553-70790523eb9f tempest-VolumesSnapshotsTestJSON-1738812212 tempest-VolumesSnapshotsTestJSON-1738812212-project] Calling method '.version_select at 0x7f2e4b3beee0>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:51:59.101821 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 11/31] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:51:58 2022] GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7 => generated 1266 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:51:59.328581 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-a1fa172b-ef6e-49bc-a553-70790523eb9f tempest-VolumesSnapshotsTestJSON-1738812212 tempest-VolumesSnapshotsTestJSON-1738812212-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/bd05addc-0dc5-42f0-a826-3d17f24a8f03" status: 200 len: 345 microversion: 2.1 time: 0.250323 Sep 20 04:51:59.336870 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 21/32] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Sep 20 04:51:59 2022] GET /compute/v2.1/os-volumes/bd05addc-0dc5-42f0-a826-3d17f24a8f03 => generated 345 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:51:59.720538 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-49b5dcbd-ceb3-41aa-9d57-eaf6b5a8c67c tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1020302331", "imageRef": "080ea053-830e-4470-a886-0ab99b0ab3e0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:51:59.808831 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.network.neutron [None req-49b5dcbd-ceb3-41aa-9d57-eaf6b5a8c67c tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] validate_networks() for [('7f03bfe9-ec72-45e7-b49d-83e075955154', None, None, None, None, None)] {{(pid=126814) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 20 04:51:59.924389 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-0293dfcb-b1d4-4a0d-a831-982c7053d446 tempest-VolumesTestJSON-172834588 tempest-VolumesTestJSON-172834588-project] Calling method '.version_select at 0x7f2e4b438e50>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:00.018154 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-0293dfcb-b1d4-4a0d-a831-982c7053d446 tempest-VolumesTestJSON-172834588 tempest-VolumesTestJSON-172834588-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/f5c9b855-4427-449f-80ac-8ec6a3aa9851" status: 200 len: 349 microversion: 2.1 time: 0.097574 Sep 20 04:52:00.018722 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 22/33] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Sep 20 04:51:59 2022] GET /compute/v2.1/os-volumes/f5c9b855-4427-449f-80ac-8ec6a3aa9851 => generated 349 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 04:52:00.086148 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-f999136d-d59f-4286-8332-251f668eb163 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:00.087395 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-f999136d-d59f-4286-8332-251f668eb163 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] [instance: 033b2f0d-760f-467a-9b3b-e7a8f2196aa7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:00.098551 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f999136d-d59f-4286-8332-251f668eb163 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:00.099228 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f999136d-d59f-4286-8332-251f668eb163 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:00.100084 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f999136d-d59f-4286-8332-251f668eb163 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:00.101021 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f999136d-d59f-4286-8332-251f668eb163 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:00.101675 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f999136d-d59f-4286-8332-251f668eb163 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:00.103897 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f999136d-d59f-4286-8332-251f668eb163 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:00.312504 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-f999136d-d59f-4286-8332-251f668eb163 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77211762af4cc9b4f0a2f74ac3ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa7ea3cb69454797bd7956e12f2a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:00.339129 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-f999136d-d59f-4286-8332-251f668eb163 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] 10.222.0.27 "GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7" status: 200 len: 1274 microversion: 2.1 time: 0.255005 Sep 20 04:52:00.340363 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 23/34] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:00 2022] GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7 => generated 1274 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:00.681150 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.virt.hardware [None req-49b5dcbd-ceb3-41aa-9d57-eaf6b5a8c67c tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Flavor limits 0:0:0 {{(pid=126814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 20 04:52:00.681625 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.virt.hardware [None req-49b5dcbd-ceb3-41aa-9d57-eaf6b5a8c67c tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Image limits 0:0:0 {{(pid=126814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 20 04:52:00.682257 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.virt.hardware [None req-49b5dcbd-ceb3-41aa-9d57-eaf6b5a8c67c tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Flavor pref 0:0:0 {{(pid=126814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 20 04:52:00.682678 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.virt.hardware [None req-49b5dcbd-ceb3-41aa-9d57-eaf6b5a8c67c tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Image pref 0:0:0 {{(pid=126814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 20 04:52:00.683102 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.virt.hardware [None req-49b5dcbd-ceb3-41aa-9d57-eaf6b5a8c67c tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 20 04:52:00.714814 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-49b5dcbd-ceb3-41aa-9d57-eaf6b5a8c67c tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:00.719391 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-49b5dcbd-ceb3-41aa-9d57-eaf6b5a8c67c tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:00.719870 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-49b5dcbd-ceb3-41aa-9d57-eaf6b5a8c67c tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:00.720720 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-49b5dcbd-ceb3-41aa-9d57-eaf6b5a8c67c tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:00.727801 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-49b5dcbd-ceb3-41aa-9d57-eaf6b5a8c67c tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:00.728864 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-49b5dcbd-ceb3-41aa-9d57-eaf6b5a8c67c tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:00.790497 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.quota [None req-49b5dcbd-ceb3-41aa-9d57-eaf6b5a8c67c tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Getting quotas for project 5f0a24f6f6994f45bd314d3009b0a572. Resources: {'ram', 'cores', 'instances'} {{(pid=126814) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 04:52:00.797988 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.quota [None req-49b5dcbd-ceb3-41aa-9d57-eaf6b5a8c67c tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Getting quotas for user 49f80b68650940e8850cbd4f84a49ef4 and project 5f0a24f6f6994f45bd314d3009b0a572. Resources: {'ram', 'cores', 'instances'} {{(pid=126814) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 04:52:00.817198 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-49b5dcbd-ceb3-41aa-9d57-eaf6b5a8c67c tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Going to run 1 instances... {{(pid=126814) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 20 04:52:00.829144 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-96146090-0446-461d-932e-9463547aeb53 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Action: 'create', calling method: .version_select at 0x7f2e4b36c820>, body: {"keypair": {"name": "tempest-keypair-1936133408", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyvQyN5odnhpyjeq48RfziJnUkXuDdrpTiFuMUvOGAhyk6S+H5eifQ23Yzkcd9PZQ5APM1jLsZnnWuxFpm8rzUCMvCjTpgZ4KQogWxIANWT1rpm9hXXNaJCdRVhwzZmPA=="}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:52:00.841177 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-49b5dcbd-ceb3-41aa-9d57-eaf6b5a8c67c tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='080ea053-830e-4470-a886-0ab99b0ab3e0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126814) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 20 04:52:00.948862 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-96146090-0446-461d-932e-9463547aeb53 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Getting quotas for project 4f0f0b8842ae496292c27a6ee1350d32. Resources: {'key_pairs'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 04:52:00.963670 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-49b5dcbd-ceb3-41aa-9d57-eaf6b5a8c67c tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.508020 Sep 20 04:52:00.972714 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-96146090-0446-461d-932e-9463547aeb53 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Getting quotas for user c93f22104a7b4a7caf0cc8b7180ffc55 and project 4f0f0b8842ae496292c27a6ee1350d32. Resources: {'key_pairs'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 04:52:00.974637 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 12/35] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Sep 20 04:51:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 1521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 20 04:52:00.982603 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-73f98df3-f1cd-4e9d-be53-71b95f65ce2f tempest-VolumesSnapshotsTestJSON-1738812212 tempest-VolumesSnapshotsTestJSON-1738812212-project] Calling method '.version_select at 0x7f2e4aa63310>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:01.098138 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-73f98df3-f1cd-4e9d-be53-71b95f65ce2f tempest-VolumesSnapshotsTestJSON-1738812212 tempest-VolumesSnapshotsTestJSON-1738812212-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/bd05addc-0dc5-42f0-a826-3d17f24a8f03" status: 200 len: 345 microversion: 2.1 time: 0.122161 Sep 20 04:52:01.098774 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 13/36] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Sep 20 04:52:00 2022] GET /compute/v2.1/os-volumes/bd05addc-0dc5-42f0-a826-3d17f24a8f03 => generated 345 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:52:01.120364 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-cf48fe95-84a6-42e6-9e68-ac00f23655d1 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:01.123256 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-cf48fe95-84a6-42e6-9e68-ac00f23655d1 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:01.145098 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-96146090-0446-461d-932e-9463547aeb53 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.802574 Sep 20 04:52:01.170612 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 24/37] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Sep 20 04:52:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:52:01.364070 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-0de11f91-6f35-47ac-a23b-ba12df8b5c31 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:01.365333 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-0de11f91-6f35-47ac-a23b-ba12df8b5c31 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] [instance: 033b2f0d-760f-467a-9b3b-e7a8f2196aa7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:01.374852 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0de11f91-6f35-47ac-a23b-ba12df8b5c31 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:01.377602 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0de11f91-6f35-47ac-a23b-ba12df8b5c31 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:01.381052 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0de11f91-6f35-47ac-a23b-ba12df8b5c31 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:01.382152 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0de11f91-6f35-47ac-a23b-ba12df8b5c31 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:01.383895 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0de11f91-6f35-47ac-a23b-ba12df8b5c31 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:01.384566 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0de11f91-6f35-47ac-a23b-ba12df8b5c31 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:01.475989 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-cf48fe95-84a6-42e6-9e68-ac00f23655d1 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:01.502894 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-cf48fe95-84a6-42e6-9e68-ac00f23655d1 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2" status: 200 len: 1222 microversion: 2.1 time: 0.402743 Sep 20 04:52:01.517335 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 14/38] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:01 2022] GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 => generated 1222 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:01.559335 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-0de11f91-6f35-47ac-a23b-ba12df8b5c31 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77211762af4cc9b4f0a2f74ac3ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa7ea3cb69454797bd7956e12f2a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:01.570738 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-0de11f91-6f35-47ac-a23b-ba12df8b5c31 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] 10.222.0.27 "GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7" status: 200 len: 1274 microversion: 2.1 time: 0.210199 Sep 20 04:52:01.574831 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 25/39] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:01 2022] GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7 => generated 1274 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:01.782933 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-9c28dd25-33d7-448f-b5c0-26bc3a606129 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2025124091", "imageRef": "080ea053-830e-4470-a886-0ab99b0ab3e0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:52:01.935682 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.network.neutron [None req-9c28dd25-33d7-448f-b5c0-26bc3a606129 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] validate_networks() for [('7f03bfe9-ec72-45e7-b49d-83e075955154', None, None, None, None, None)] {{(pid=126814) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 20 04:52:02.117767 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-59fa7cce-e72a-40d2-898c-c649ce034eeb tempest-VolumesSnapshotsTestJSON-1738812212 tempest-VolumesSnapshotsTestJSON-1738812212-project] Calling method '.version_select at 0x7f2e4b287e50>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:02.238270 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-59fa7cce-e72a-40d2-898c-c649ce034eeb tempest-VolumesSnapshotsTestJSON-1738812212 tempest-VolumesSnapshotsTestJSON-1738812212-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/bd05addc-0dc5-42f0-a826-3d17f24a8f03" status: 200 len: 345 microversion: 2.1 time: 0.127138 Sep 20 04:52:02.248535 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 26/40] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Sep 20 04:52:02 2022] GET /compute/v2.1/os-volumes/bd05addc-0dc5-42f0-a826-3d17f24a8f03 => generated 345 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:52:02.604575 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-cb89fd1e-0fe5-4cf2-bb97-8988271c3e00 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:02.605274 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-cb89fd1e-0fe5-4cf2-bb97-8988271c3e00 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] [instance: 033b2f0d-760f-467a-9b3b-e7a8f2196aa7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:02.627834 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-cb89fd1e-0fe5-4cf2-bb97-8988271c3e00 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:02.630295 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-cb89fd1e-0fe5-4cf2-bb97-8988271c3e00 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:02.630774 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-cb89fd1e-0fe5-4cf2-bb97-8988271c3e00 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:02.634381 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-cb89fd1e-0fe5-4cf2-bb97-8988271c3e00 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:02.634967 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-cb89fd1e-0fe5-4cf2-bb97-8988271c3e00 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:02.635426 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-cb89fd1e-0fe5-4cf2-bb97-8988271c3e00 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:03.955730 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-cb89fd1e-0fe5-4cf2-bb97-8988271c3e00 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77211762af4cc9b4f0a2f74ac3ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa7ea3cb69454797bd7956e12f2a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:03.971497 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-cb89fd1e-0fe5-4cf2-bb97-8988271c3e00 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] 10.222.0.27 "GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7" status: 200 len: 1272 microversion: 2.1 time: 1.375653 Sep 20 04:52:03.986856 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 27/41] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:02 2022] GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7 => generated 1272 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:04.010489 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-2c96f0e0-7960-4633-8470-1791db8e7ef4 tempest-VolumesTestJSON-172834588 tempest-VolumesTestJSON-172834588-project] Calling method '.version_select at 0x7f2e4b2d08b0>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:04.183787 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-2c96f0e0-7960-4633-8470-1791db8e7ef4 tempest-VolumesTestJSON-172834588 tempest-VolumesTestJSON-172834588-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/dd989bee-e209-4754-b51c-47efa67d7945" status: 200 len: 351 microversion: 2.1 time: 0.195032 Sep 20 04:52:04.184399 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 28/42] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Sep 20 04:52:03 2022] GET /compute/v2.1/os-volumes/dd989bee-e209-4754-b51c-47efa67d7945 => generated 351 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:52:04.199676 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-8e3ceea3-106c-4d24-9a6e-442989062437 tempest-VolumesSnapshotsTestJSON-1738812212 tempest-VolumesSnapshotsTestJSON-1738812212-project] Calling method '.version_select at 0x7f2e4b287b80>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:04.387447 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.wsgi [None req-8e3ceea3-106c-4d24-9a6e-442989062437 tempest-VolumesSnapshotsTestJSON-1738812212 tempest-VolumesSnapshotsTestJSON-1738812212-project] HTTP exception thrown: Volume bd05addc-0dc5-42f0-a826-3d17f24a8f03 could not be found. Sep 20 04:52:04.389592 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-8e3ceea3-106c-4d24-9a6e-442989062437 tempest-VolumesSnapshotsTestJSON-1738812212 tempest-VolumesSnapshotsTestJSON-1738812212-project] Request method failure captured: Sep 20 04:52:04.389592 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: request: GET /compute/v2.1/os-volumes/bd05addc-0dc5-42f0-a826-3d17f24a8f03 HTTP/1.1 Sep 20 04:52:04.389592 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept: application/json Sep 20 04:52:04.389592 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept-Encoding: identity Sep 20 04:52:04.389592 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Connection: close Sep 20 04:52:04.389592 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Length: 0 Sep 20 04:52:04.389592 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Type: application/json Sep 20 04:52:04.389592 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Host: 10.222.0.27 Sep 20 04:52:04.389592 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Openstack-System-Scope: None Sep 20 04:52:04.389592 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: User-Agent: python-urllib3/1.26.12 Sep 20 04:52:04.389592 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Auth-Token: gAAAAABjKUbiaqowVZKUKvwe-FtRO48IgGJ_3UAr10rvWX3q1gnaD2G4mQyI9MbqK4rpabQ17rcTg41eQsKFBbqB31fppMERUhOSZLltKyxHOcW3w0ryB3adrvlQmStnIsBfXURHwCk8I6pKsG0LBByPCLmfBM4Sgz6bqSU-wS3h3CUly4umhl0 Sep 20 04:52:04.389592 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Id: None Sep 20 04:52:04.389592 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Name: None Sep 20 04:52:04.389592 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Identity-Status: Confirmed Sep 20 04:52:04.389592 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Is-Admin-Project: True Sep 20 04:52:04.389592 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Id: default Sep 20 04:52:04.389592 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Name: Default Sep 20 04:52:04.389592 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Id: c2376275534c4c0bb4d279a625a1bdcd Sep 20 04:52:04.389592 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1738812212 Sep 20 04:52:04.389592 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Role: reader,member Sep 20 04:52:04.389592 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Roles: reader,member Sep 20 04:52:04.390747 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c2376275534c4c0bb4d279a625a1bdcd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c2376275534c4c0bb4d279a625a1bdcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c2376275534c4c0bb4d279a625a1bdcd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c2376275534c4c0bb4d279a625a1bdcd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 04:52:04.390747 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1738812212 Sep 20 04:52:04.390747 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Id: c2376275534c4c0bb4d279a625a1bdcd Sep 20 04:52:04.390747 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1738812212 Sep 20 04:52:04.390747 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User: tempest-VolumesSnapshotsTestJSON-1738812212-project Sep 20 04:52:04.390747 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Id: default Sep 20 04:52:04.390747 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Name: Default Sep 20 04:52:04.390747 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Id: 83fd4adb347749a1ba1df6bf78e19118 Sep 20 04:52:04.390747 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1738812212-project Sep 20 04:52:04.390747 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: method: Sep 20 04:52:04.390747 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: exception: Volume bd05addc-0dc5-42f0-a826-3d17f24a8f03 could not be found. Sep 20 04:52:04.390747 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: action_args: {'id': 'bd05addc-0dc5-42f0-a826-3d17f24a8f03'} Sep 20 04:52:04.390747 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 04:52:04.391515 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:52:04.391515 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 20 04:52:04.391515 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 20 04:52:04.391515 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 20 04:52:04.391515 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 20 04:52:04.391515 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 20 04:52:04.391515 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 20 04:52:04.391515 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 20 04:52:04.391515 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 20 04:52:04.391515 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 20 04:52:04.391515 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 20 04:52:04.391515 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 20 04:52:04.391515 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 20 04:52:04.391515 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 20 04:52:04.391515 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 20 04:52:04.391515 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bd05addc-0dc5-42f0-a826-3d17f24a8f03 could not be found. (HTTP 404) (Request-ID: req-b7a735de-91c5-43ca-b3e2-2e2f6d61f53d) Sep 20 04:52:04.391515 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:52:04.391515 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:52:04.391515 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:52:04.393134 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:52:04.393134 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 20 04:52:04.393134 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 20 04:52:04.393134 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 20 04:52:04.393134 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 20 04:52:04.393134 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 20 04:52:04.393134 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 20 04:52:04.393134 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 20 04:52:04.393134 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 20 04:52:04.393134 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 20 04:52:04.393134 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 20 04:52:04.393134 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 20 04:52:04.393134 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 20 04:52:04.393134 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 20 04:52:04.393134 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 20 04:52:04.393134 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 20 04:52:04.393134 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 20 04:52:04.393134 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 20 04:52:04.393134 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 20 04:52:04.394087 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 20 04:52:04.394087 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 20 04:52:04.394087 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 20 04:52:04.394087 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 20 04:52:04.394087 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bd05addc-0dc5-42f0-a826-3d17f24a8f03 could not be found. Sep 20 04:52:04.394087 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:52:04.394087 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:52:04.394087 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:52:04.394087 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:52:04.394087 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:52:04.394087 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:52:04.394087 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 04:52:04.394087 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 04:52:04.394087 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 20 04:52:04.394087 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 20 04:52:04.394087 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 04:52:04.394087 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 04:52:04.394087 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 20 04:52:04.394087 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 04:52:04.395015 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bd05addc-0dc5-42f0-a826-3d17f24a8f03 could not be found. Sep 20 04:52:04.395015 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:52:04.395015 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:52:04.395015 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:52:04.395015 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:52:04.395015 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:52:04.395015 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:52:04.395015 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 04:52:04.395015 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 04:52:04.395015 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bd05addc-0dc5-42f0-a826-3d17f24a8f03 could not be found. Sep 20 04:52:04.395015 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:52:04.395015 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-8e3ceea3-106c-4d24-9a6e-442989062437 tempest-VolumesSnapshotsTestJSON-1738812212 tempest-VolumesSnapshotsTestJSON-1738812212-project] Returning 404 to user: Volume bd05addc-0dc5-42f0-a826-3d17f24a8f03 could not be found. {{(pid=126813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 04:52:04.395015 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-8e3ceea3-106c-4d24-9a6e-442989062437 tempest-VolumesSnapshotsTestJSON-1738812212 tempest-VolumesSnapshotsTestJSON-1738812212-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/bd05addc-0dc5-42f0-a826-3d17f24a8f03" status: 404 len: 109 microversion: 2.1 time: 0.197555 Sep 20 04:52:04.395015 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 29/43] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Sep 20 04:52:04 2022] GET /compute/v2.1/os-volumes/bd05addc-0dc5-42f0-a826-3d17f24a8f03 => generated 109 bytes in 207 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 20 04:52:04.407029 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-8ec5a385-8011-4e23-95a4-52be8211fe56 tempest-VolumesSnapshotsTestJSON-1738812212 tempest-VolumesSnapshotsTestJSON-1738812212-project] Calling method '.version_select at 0x7f2e4b4de430>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:04.604156 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.wsgi [None req-8ec5a385-8011-4e23-95a4-52be8211fe56 tempest-VolumesSnapshotsTestJSON-1738812212 tempest-VolumesSnapshotsTestJSON-1738812212-project] HTTP exception thrown: Volume bd05addc-0dc5-42f0-a826-3d17f24a8f03 could not be found. Sep 20 04:52:04.608704 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-8ec5a385-8011-4e23-95a4-52be8211fe56 tempest-VolumesSnapshotsTestJSON-1738812212 tempest-VolumesSnapshotsTestJSON-1738812212-project] Request method failure captured: Sep 20 04:52:04.608704 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: request: DELETE /compute/v2.1/os-volumes/bd05addc-0dc5-42f0-a826-3d17f24a8f03 HTTP/1.1 Sep 20 04:52:04.608704 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept: application/json Sep 20 04:52:04.608704 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept-Encoding: identity Sep 20 04:52:04.608704 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Connection: close Sep 20 04:52:04.608704 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Length: 0 Sep 20 04:52:04.608704 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Type: application/json Sep 20 04:52:04.608704 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Host: 10.222.0.27 Sep 20 04:52:04.608704 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Openstack-System-Scope: None Sep 20 04:52:04.608704 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: User-Agent: python-urllib3/1.26.12 Sep 20 04:52:04.608704 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Auth-Token: gAAAAABjKUbiaqowVZKUKvwe-FtRO48IgGJ_3UAr10rvWX3q1gnaD2G4mQyI9MbqK4rpabQ17rcTg41eQsKFBbqB31fppMERUhOSZLltKyxHOcW3w0ryB3adrvlQmStnIsBfXURHwCk8I6pKsG0LBByPCLmfBM4Sgz6bqSU-wS3h3CUly4umhl0 Sep 20 04:52:04.608704 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Id: None Sep 20 04:52:04.608704 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Name: None Sep 20 04:52:04.608704 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Identity-Status: Confirmed Sep 20 04:52:04.608704 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Is-Admin-Project: True Sep 20 04:52:04.608704 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Id: default Sep 20 04:52:04.608704 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Name: Default Sep 20 04:52:04.608704 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Id: c2376275534c4c0bb4d279a625a1bdcd Sep 20 04:52:04.608704 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1738812212 Sep 20 04:52:04.608704 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Role: reader,member Sep 20 04:52:04.608704 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Roles: reader,member Sep 20 04:52:04.610124 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c2376275534c4c0bb4d279a625a1bdcd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c2376275534c4c0bb4d279a625a1bdcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c2376275534c4c0bb4d279a625a1bdcd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c2376275534c4c0bb4d279a625a1bdcd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 04:52:04.610124 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1738812212 Sep 20 04:52:04.610124 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Id: c2376275534c4c0bb4d279a625a1bdcd Sep 20 04:52:04.610124 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1738812212 Sep 20 04:52:04.610124 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User: tempest-VolumesSnapshotsTestJSON-1738812212-project Sep 20 04:52:04.610124 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Id: default Sep 20 04:52:04.610124 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Name: Default Sep 20 04:52:04.610124 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Id: 83fd4adb347749a1ba1df6bf78e19118 Sep 20 04:52:04.610124 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1738812212-project Sep 20 04:52:04.610124 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: method: Sep 20 04:52:04.610124 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: exception: Volume bd05addc-0dc5-42f0-a826-3d17f24a8f03 could not be found. Sep 20 04:52:04.610124 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: action_args: {'id': 'bd05addc-0dc5-42f0-a826-3d17f24a8f03'} Sep 20 04:52:04.610124 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 04:52:04.610958 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:52:04.610958 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 20 04:52:04.610958 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 20 04:52:04.610958 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 20 04:52:04.610958 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 20 04:52:04.610958 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 20 04:52:04.610958 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 20 04:52:04.610958 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 20 04:52:04.610958 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 20 04:52:04.610958 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 20 04:52:04.610958 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 20 04:52:04.610958 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 20 04:52:04.610958 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 20 04:52:04.610958 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 20 04:52:04.610958 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 20 04:52:04.610958 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bd05addc-0dc5-42f0-a826-3d17f24a8f03 could not be found. (HTTP 404) (Request-ID: req-eaf83ded-5a99-4752-bf22-e58874d98fc2) Sep 20 04:52:04.610958 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:52:04.610958 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:52:04.610958 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:52:04.612260 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:52:04.612260 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 20 04:52:04.612260 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 20 04:52:04.612260 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 20 04:52:04.612260 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 20 04:52:04.612260 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 20 04:52:04.612260 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 20 04:52:04.612260 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 20 04:52:04.612260 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 20 04:52:04.612260 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 20 04:52:04.612260 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 20 04:52:04.612260 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 20 04:52:04.612260 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 20 04:52:04.612260 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 20 04:52:04.612260 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 20 04:52:04.612260 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 20 04:52:04.612260 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 20 04:52:04.612260 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 20 04:52:04.612260 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 20 04:52:04.613478 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 20 04:52:04.613478 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 20 04:52:04.613478 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 20 04:52:04.613478 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 20 04:52:04.613478 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bd05addc-0dc5-42f0-a826-3d17f24a8f03 could not be found. Sep 20 04:52:04.613478 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:52:04.613478 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:52:04.613478 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:52:04.613478 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:52:04.613478 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:52:04.613478 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:52:04.613478 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 04:52:04.613478 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 04:52:04.613478 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 20 04:52:04.613478 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 20 04:52:04.613478 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 04:52:04.613478 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 04:52:04.613478 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 20 04:52:04.613478 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 04:52:04.614775 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bd05addc-0dc5-42f0-a826-3d17f24a8f03 could not be found. Sep 20 04:52:04.614775 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:52:04.614775 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:52:04.614775 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:52:04.614775 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:52:04.614775 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:52:04.614775 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:52:04.614775 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 04:52:04.614775 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 04:52:04.614775 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bd05addc-0dc5-42f0-a826-3d17f24a8f03 could not be found. Sep 20 04:52:04.614775 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:52:04.615493 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-8ec5a385-8011-4e23-95a4-52be8211fe56 tempest-VolumesSnapshotsTestJSON-1738812212 tempest-VolumesSnapshotsTestJSON-1738812212-project] Returning 404 to user: Volume bd05addc-0dc5-42f0-a826-3d17f24a8f03 could not be found. {{(pid=126813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 04:52:04.617083 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-8ec5a385-8011-4e23-95a4-52be8211fe56 tempest-VolumesSnapshotsTestJSON-1738812212 tempest-VolumesSnapshotsTestJSON-1738812212-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/bd05addc-0dc5-42f0-a826-3d17f24a8f03" status: 404 len: 109 microversion: 2.1 time: 0.214296 Sep 20 04:52:04.625892 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 30/44] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Sep 20 04:52:04 2022] DELETE /compute/v2.1/os-volumes/bd05addc-0dc5-42f0-a826-3d17f24a8f03 => generated 109 bytes in 224 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 20 04:52:04.652300 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-2d4e78c6-af08-41d9-9901-795f93711453 tempest-VolumesSnapshotsTestJSON-1738812212 tempest-VolumesSnapshotsTestJSON-1738812212-project] Calling method '.version_select at 0x7f2e4b344dc0>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:05.091132 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.wsgi [None req-2d4e78c6-af08-41d9-9901-795f93711453 tempest-VolumesSnapshotsTestJSON-1738812212 tempest-VolumesSnapshotsTestJSON-1738812212-project] HTTP exception thrown: Volume bd05addc-0dc5-42f0-a826-3d17f24a8f03 could not be found. Sep 20 04:52:05.098216 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-2d4e78c6-af08-41d9-9901-795f93711453 tempest-VolumesSnapshotsTestJSON-1738812212 tempest-VolumesSnapshotsTestJSON-1738812212-project] Request method failure captured: Sep 20 04:52:05.098216 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: request: GET /compute/v2.1/os-volumes/bd05addc-0dc5-42f0-a826-3d17f24a8f03 HTTP/1.1 Sep 20 04:52:05.098216 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept: application/json Sep 20 04:52:05.098216 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept-Encoding: identity Sep 20 04:52:05.098216 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Connection: close Sep 20 04:52:05.098216 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Length: 0 Sep 20 04:52:05.098216 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Type: application/json Sep 20 04:52:05.098216 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Host: 10.222.0.27 Sep 20 04:52:05.098216 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Openstack-System-Scope: None Sep 20 04:52:05.098216 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: User-Agent: python-urllib3/1.26.12 Sep 20 04:52:05.098216 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Auth-Token: gAAAAABjKUbiaqowVZKUKvwe-FtRO48IgGJ_3UAr10rvWX3q1gnaD2G4mQyI9MbqK4rpabQ17rcTg41eQsKFBbqB31fppMERUhOSZLltKyxHOcW3w0ryB3adrvlQmStnIsBfXURHwCk8I6pKsG0LBByPCLmfBM4Sgz6bqSU-wS3h3CUly4umhl0 Sep 20 04:52:05.098216 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Id: None Sep 20 04:52:05.098216 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Name: None Sep 20 04:52:05.098216 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Identity-Status: Confirmed Sep 20 04:52:05.098216 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Is-Admin-Project: True Sep 20 04:52:05.098216 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Id: default Sep 20 04:52:05.098216 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Name: Default Sep 20 04:52:05.098216 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Id: c2376275534c4c0bb4d279a625a1bdcd Sep 20 04:52:05.098216 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1738812212 Sep 20 04:52:05.098216 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Role: reader,member Sep 20 04:52:05.098216 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Roles: reader,member Sep 20 04:52:05.099672 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c2376275534c4c0bb4d279a625a1bdcd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c2376275534c4c0bb4d279a625a1bdcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c2376275534c4c0bb4d279a625a1bdcd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c2376275534c4c0bb4d279a625a1bdcd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 04:52:05.099672 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1738812212 Sep 20 04:52:05.099672 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Id: c2376275534c4c0bb4d279a625a1bdcd Sep 20 04:52:05.099672 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1738812212 Sep 20 04:52:05.099672 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User: tempest-VolumesSnapshotsTestJSON-1738812212-project Sep 20 04:52:05.099672 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Id: default Sep 20 04:52:05.099672 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Name: Default Sep 20 04:52:05.099672 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Id: 83fd4adb347749a1ba1df6bf78e19118 Sep 20 04:52:05.099672 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1738812212-project Sep 20 04:52:05.099672 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: method: Sep 20 04:52:05.099672 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: exception: Volume bd05addc-0dc5-42f0-a826-3d17f24a8f03 could not be found. Sep 20 04:52:05.099672 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: action_args: {'id': 'bd05addc-0dc5-42f0-a826-3d17f24a8f03'} Sep 20 04:52:05.099672 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 04:52:05.100512 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:52:05.100512 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 20 04:52:05.100512 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 20 04:52:05.100512 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 20 04:52:05.100512 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 20 04:52:05.100512 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 20 04:52:05.100512 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 20 04:52:05.100512 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 20 04:52:05.100512 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 20 04:52:05.100512 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 20 04:52:05.100512 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 20 04:52:05.100512 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 20 04:52:05.100512 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 20 04:52:05.100512 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 20 04:52:05.100512 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 20 04:52:05.100512 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bd05addc-0dc5-42f0-a826-3d17f24a8f03 could not be found. (HTTP 404) (Request-ID: req-3baf2ee9-4720-499b-bbbc-02a9866b899d) Sep 20 04:52:05.100512 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:52:05.100512 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:52:05.100512 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:52:05.101858 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:52:05.101858 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 20 04:52:05.101858 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 20 04:52:05.101858 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 20 04:52:05.101858 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 20 04:52:05.101858 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 20 04:52:05.101858 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 20 04:52:05.101858 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 20 04:52:05.101858 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 20 04:52:05.101858 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 20 04:52:05.101858 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 20 04:52:05.101858 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 20 04:52:05.101858 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 20 04:52:05.101858 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 20 04:52:05.101858 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 20 04:52:05.101858 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 20 04:52:05.101858 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 20 04:52:05.101858 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 20 04:52:05.101858 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 20 04:52:05.103546 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 20 04:52:05.103546 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 20 04:52:05.103546 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 20 04:52:05.103546 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 20 04:52:05.103546 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bd05addc-0dc5-42f0-a826-3d17f24a8f03 could not be found. Sep 20 04:52:05.103546 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:52:05.103546 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:52:05.103546 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:52:05.103546 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:52:05.103546 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:52:05.103546 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:52:05.103546 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 04:52:05.103546 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 04:52:05.103546 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 20 04:52:05.103546 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 20 04:52:05.103546 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 04:52:05.103546 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 04:52:05.103546 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 20 04:52:05.103546 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 04:52:05.104938 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bd05addc-0dc5-42f0-a826-3d17f24a8f03 could not be found. Sep 20 04:52:05.104938 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:52:05.104938 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:52:05.104938 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:52:05.104938 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:52:05.104938 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:52:05.104938 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:52:05.104938 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 04:52:05.104938 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 04:52:05.104938 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bd05addc-0dc5-42f0-a826-3d17f24a8f03 could not be found. Sep 20 04:52:05.104938 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:52:05.107577 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-2d4e78c6-af08-41d9-9901-795f93711453 tempest-VolumesSnapshotsTestJSON-1738812212 tempest-VolumesSnapshotsTestJSON-1738812212-project] Returning 404 to user: Volume bd05addc-0dc5-42f0-a826-3d17f24a8f03 could not be found. {{(pid=126813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 04:52:05.109900 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-2d4e78c6-af08-41d9-9901-795f93711453 tempest-VolumesSnapshotsTestJSON-1738812212 tempest-VolumesSnapshotsTestJSON-1738812212-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/bd05addc-0dc5-42f0-a826-3d17f24a8f03" status: 404 len: 109 microversion: 2.1 time: 0.482096 Sep 20 04:52:05.118293 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 31/45] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Sep 20 04:52:04 2022] GET /compute/v2.1/os-volumes/bd05addc-0dc5-42f0-a826-3d17f24a8f03 => generated 109 bytes in 492 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 20 04:52:05.179823 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-4ef18e39-9720-4fab-acc9-42817cf3bd30 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:05.191270 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-4ef18e39-9720-4fab-acc9-42817cf3bd30 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] [instance: 033b2f0d-760f-467a-9b3b-e7a8f2196aa7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:05.242584 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4ef18e39-9720-4fab-acc9-42817cf3bd30 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:05.243222 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4ef18e39-9720-4fab-acc9-42817cf3bd30 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:05.246284 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4ef18e39-9720-4fab-acc9-42817cf3bd30 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:05.251146 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4ef18e39-9720-4fab-acc9-42817cf3bd30 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:05.251691 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4ef18e39-9720-4fab-acc9-42817cf3bd30 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:05.252135 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4ef18e39-9720-4fab-acc9-42817cf3bd30 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:05.826815 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-4ef18e39-9720-4fab-acc9-42817cf3bd30 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77211762af4cc9b4f0a2f74ac3ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa7ea3cb69454797bd7956e12f2a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:05.846683 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-4ef18e39-9720-4fab-acc9-42817cf3bd30 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] 10.222.0.27 "GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7" status: 200 len: 1272 microversion: 2.1 time: 0.718242 Sep 20 04:52:05.849380 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 32/46] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:05 2022] GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7 => generated 1272 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:06.568760 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-668fe7b9-1d39-48d0-a726-53d924bc8397 tempest-VolumesTestJSON-172834588 tempest-VolumesTestJSON-172834588-project] Calling method '.version_select at 0x7f2e4b2a6280>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:06.742700 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-668fe7b9-1d39-48d0-a726-53d924bc8397 tempest-VolumesTestJSON-172834588 tempest-VolumesTestJSON-172834588-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/2a3f5808-6018-4fa5-8ddc-88881a9a7ade" status: 200 len: 350 microversion: 2.1 time: 0.179490 Sep 20 04:52:06.744325 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 33/47] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Sep 20 04:52:06 2022] GET /compute/v2.1/os-volumes/2a3f5808-6018-4fa5-8ddc-88881a9a7ade => generated 350 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:52:06.761970 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-68094b11-8c80-45f8-a411-528fb515974d tempest-VolumesTestJSON-172834588 tempest-VolumesTestJSON-172834588-project] Calling method '.version_select at 0x7f2e4b29e0d0>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:07.194698 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-68094b11-8c80-45f8-a411-528fb515974d tempest-VolumesTestJSON-172834588 tempest-VolumesTestJSON-172834588-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.437161 Sep 20 04:52:07.195890 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 34/48] 10.222.0.27 () {58 vars in 1134 bytes} [Tue Sep 20 04:52:06 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:07.201532 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-a4639488-492c-4f9f-af19-087f91005e25 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:07.203881 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-a4639488-492c-4f9f-af19-087f91005e25 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] [instance: 033b2f0d-760f-467a-9b3b-e7a8f2196aa7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:07.229815 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a4639488-492c-4f9f-af19-087f91005e25 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:07.236459 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a4639488-492c-4f9f-af19-087f91005e25 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:07.240576 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a4639488-492c-4f9f-af19-087f91005e25 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:07.242740 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a4639488-492c-4f9f-af19-087f91005e25 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:07.246512 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a4639488-492c-4f9f-af19-087f91005e25 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:07.247987 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a4639488-492c-4f9f-af19-087f91005e25 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:07.543312 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.virt.hardware [None req-9c28dd25-33d7-448f-b5c0-26bc3a606129 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Flavor limits 0:0:0 {{(pid=126814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 20 04:52:07.544868 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.virt.hardware [None req-9c28dd25-33d7-448f-b5c0-26bc3a606129 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Image limits 0:0:0 {{(pid=126814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 20 04:52:07.546835 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.virt.hardware [None req-9c28dd25-33d7-448f-b5c0-26bc3a606129 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Flavor pref 0:0:0 {{(pid=126814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 20 04:52:07.548105 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.virt.hardware [None req-9c28dd25-33d7-448f-b5c0-26bc3a606129 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Image pref 0:0:0 {{(pid=126814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 20 04:52:07.548852 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.virt.hardware [None req-9c28dd25-33d7-448f-b5c0-26bc3a606129 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 20 04:52:07.581527 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-9c28dd25-33d7-448f-b5c0-26bc3a606129 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:07.592817 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-9c28dd25-33d7-448f-b5c0-26bc3a606129 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:07.593808 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-9c28dd25-33d7-448f-b5c0-26bc3a606129 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:07.595194 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-9c28dd25-33d7-448f-b5c0-26bc3a606129 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:07.596295 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-9c28dd25-33d7-448f-b5c0-26bc3a606129 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:07.598116 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-9c28dd25-33d7-448f-b5c0-26bc3a606129 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:07.700956 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.quota [None req-9c28dd25-33d7-448f-b5c0-26bc3a606129 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Getting quotas for project 5f0a24f6f6994f45bd314d3009b0a572. Resources: {'ram', 'cores', 'instances'} {{(pid=126814) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 04:52:07.719945 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.quota [None req-9c28dd25-33d7-448f-b5c0-26bc3a606129 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Getting quotas for user 49f80b68650940e8850cbd4f84a49ef4 and project 5f0a24f6f6994f45bd314d3009b0a572. Resources: {'ram', 'cores', 'instances'} {{(pid=126814) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 04:52:07.782195 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-9c28dd25-33d7-448f-b5c0-26bc3a606129 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Going to run 1 instances... {{(pid=126814) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 20 04:52:07.787276 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-9c28dd25-33d7-448f-b5c0-26bc3a606129 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='080ea053-830e-4470-a886-0ab99b0ab3e0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126814) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 20 04:52:07.965334 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-9c28dd25-33d7-448f-b5c0-26bc3a606129 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.189287 Sep 20 04:52:07.982779 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 15/49] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Sep 20 04:52:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 6207 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 20 04:52:08.011068 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-56363f5d-e6a4-40ec-8810-c42073120e0a tempest-VolumesTestJSON-172834588 tempest-VolumesTestJSON-172834588-project] Calling method '.version_select at 0x7f2e4aa67550>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:08.308413 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-56363f5d-e6a4-40ec-8810-c42073120e0a tempest-VolumesTestJSON-172834588 tempest-VolumesTestJSON-172834588-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.324121 Sep 20 04:52:08.309172 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 16/50] 10.222.0.27 () {58 vars in 1149 bytes} [Tue Sep 20 04:52:07 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:52:08.325268 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-ce0507d0-c579-4f36-b638-cdd535bec1c3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:08.331934 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-ce0507d0-c579-4f36-b638-cdd535bec1c3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:08.334359 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-a4639488-492c-4f9f-af19-087f91005e25 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77211762af4cc9b4f0a2f74ac3ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa7ea3cb69454797bd7956e12f2a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:08.367107 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-a4639488-492c-4f9f-af19-087f91005e25 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] 10.222.0.27 "GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7" status: 200 len: 1314 microversion: 2.1 time: 1.168762 Sep 20 04:52:08.369336 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 35/51] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:07 2022] GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7 => generated 1314 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:08.382016 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-f9e78e22-86f4-49b8-be76-a030ce62c1b7 tempest-VolumesTestJSON-172834588 tempest-VolumesTestJSON-172834588-project] Calling method '.version_select at 0x7f2e4b4de1f0>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:08.748216 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-ce0507d0-c579-4f36-b638-cdd535bec1c3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:08.765606 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-ce0507d0-c579-4f36-b638-cdd535bec1c3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1222 microversion: 2.1 time: 0.444875 Sep 20 04:52:08.789157 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-f9e78e22-86f4-49b8-be76-a030ce62c1b7 tempest-VolumesTestJSON-172834588 tempest-VolumesTestJSON-172834588-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.413890 Sep 20 04:52:08.799270 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 17/52] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:08 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1222 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:08.799931 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 36/53] 10.222.0.27 () {58 vars in 1134 bytes} [Tue Sep 20 04:52:08 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:08.814204 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-3a58be47-911b-41eb-92f4-8463502082c2 tempest-VolumesTestJSON-172834588 tempest-VolumesTestJSON-172834588-project] Calling method '.version_select at 0x7f2e4aa47ee0>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:09.091289 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-3a58be47-911b-41eb-92f4-8463502082c2 tempest-VolumesTestJSON-172834588 tempest-VolumesTestJSON-172834588-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.288445 Sep 20 04:52:09.093907 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 18/54] 10.222.0.27 () {58 vars in 1167 bytes} [Tue Sep 20 04:52:08 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:52:09.118438 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-0ad6b738-b6de-4168-b9dc-668c5618c3df tempest-VolumesTestJSON-172834588 tempest-VolumesTestJSON-172834588-project] Calling method '.version_select at 0x7f2e4b2873a0>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:09.335965 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-0ad6b738-b6de-4168-b9dc-668c5618c3df tempest-VolumesTestJSON-172834588 tempest-VolumesTestJSON-172834588-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.230979 Sep 20 04:52:09.346489 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 37/55] 10.222.0.27 () {58 vars in 1170 bytes} [Tue Sep 20 04:52:09 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:52:09.355620 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-729193af-bf0a-4f7f-9d37-55bacf52fa13 tempest-VolumesTestJSON-172834588 tempest-VolumesTestJSON-172834588-project] Calling method '.version_select at 0x7f2e4aa624c0>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:09.395474 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-cb5fe64b-146d-45ac-8361-7327dbe4468f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:09.396499 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-cb5fe64b-146d-45ac-8361-7327dbe4468f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] [instance: 033b2f0d-760f-467a-9b3b-e7a8f2196aa7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:09.422234 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-cb5fe64b-146d-45ac-8361-7327dbe4468f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:09.423162 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-cb5fe64b-146d-45ac-8361-7327dbe4468f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:09.425735 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-cb5fe64b-146d-45ac-8361-7327dbe4468f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:09.426768 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-cb5fe64b-146d-45ac-8361-7327dbe4468f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:09.427381 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-cb5fe64b-146d-45ac-8361-7327dbe4468f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:09.428727 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-cb5fe64b-146d-45ac-8361-7327dbe4468f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:09.609555 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-729193af-bf0a-4f7f-9d37-55bacf52fa13 tempest-VolumesTestJSON-172834588 tempest-VolumesTestJSON-172834588-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.260696 Sep 20 04:52:09.610745 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 19/56] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Sep 20 04:52:09 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:09.624826 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-37146b1b-3959-45ec-b710-c2d7781f6575 tempest-VolumesTestJSON-172834588 tempest-VolumesTestJSON-172834588-project] Calling method '.version_select at 0x7f2e4aa14940>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:09.925845 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-37146b1b-3959-45ec-b710-c2d7781f6575 tempest-VolumesTestJSON-172834588 tempest-VolumesTestJSON-172834588-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.305423 Sep 20 04:52:09.927042 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 20/57] 10.222.0.27 () {58 vars in 1188 bytes} [Tue Sep 20 04:52:09 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:52:09.940154 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-7a111d4e-ea7b-4f71-96cd-be7e1853f14f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:09.940880 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-7a111d4e-ea7b-4f71-96cd-be7e1853f14f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:09.963766 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-7a111d4e-ea7b-4f71-96cd-be7e1853f14f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:09.963766 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-7a111d4e-ea7b-4f71-96cd-be7e1853f14f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:09.963766 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-7a111d4e-ea7b-4f71-96cd-be7e1853f14f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:09.963766 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-7a111d4e-ea7b-4f71-96cd-be7e1853f14f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:09.964222 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-7a111d4e-ea7b-4f71-96cd-be7e1853f14f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:09.964222 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-7a111d4e-ea7b-4f71-96cd-be7e1853f14f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:10.014841 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-cb5fe64b-146d-45ac-8361-7327dbe4468f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77211762af4cc9b4f0a2f74ac3ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa7ea3cb69454797bd7956e12f2a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:10.028786 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-cb5fe64b-146d-45ac-8361-7327dbe4468f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] 10.222.0.27 "GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7" status: 200 len: 1314 microversion: 2.1 time: 0.637918 Sep 20 04:52:10.033339 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 38/58] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:09 2022] GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7 => generated 1314 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:10.058999 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-30f7aecd-1ce5-4969-b232-c37de8fd5518 tempest-VolumesTestJSON-172834588 tempest-VolumesTestJSON-172834588-project] Calling method '.version_select at 0x7f2e4b29e9d0>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:10.451404 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-30f7aecd-1ce5-4969-b232-c37de8fd5518 tempest-VolumesTestJSON-172834588 tempest-VolumesTestJSON-172834588-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.411992 Sep 20 04:52:10.466475 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 39/59] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Sep 20 04:52:10 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:10.530915 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-85bdc726-e209-4f8d-abca-9f9eb3e9fd34 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2097865374", "imageRef": "080ea053-830e-4470-a886-0ab99b0ab3e0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "637b3136-e650-47ef-a9fe-492091eb8174"}], "security_groups": [{"name": "tempest-securitygroup--2032431863"}], "key_name": "tempest-keypair-1936133408", "user_data": "}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:52:10.704879 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-7a111d4e-ea7b-4f71-96cd-be7e1853f14f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:10.717956 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-7a111d4e-ea7b-4f71-96cd-be7e1853f14f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1218 microversion: 2.1 time: 0.789716 Sep 20 04:52:10.742877 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 21/60] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:09 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1218 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:11.016567 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell0:SELECT=8 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:11.062364 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-e4bab2e6-c7b5-4ac7-9b9c-e82cdd5e25c6 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:11.066738 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-e4bab2e6-c7b5-4ac7-9b9c-e82cdd5e25c6 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] [instance: 033b2f0d-760f-467a-9b3b-e7a8f2196aa7] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:11.102105 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-e4bab2e6-c7b5-4ac7-9b9c-e82cdd5e25c6 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:11.103230 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-e4bab2e6-c7b5-4ac7-9b9c-e82cdd5e25c6 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:11.105518 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-e4bab2e6-c7b5-4ac7-9b9c-e82cdd5e25c6 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:11.107383 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-e4bab2e6-c7b5-4ac7-9b9c-e82cdd5e25c6 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:11.108099 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-e4bab2e6-c7b5-4ac7-9b9c-e82cdd5e25c6 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:11.110621 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-e4bab2e6-c7b5-4ac7-9b9c-e82cdd5e25c6 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:12.417321 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.network.neutron [None req-85bdc726-e209-4f8d-abca-9f9eb3e9fd34 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] validate_networks() for [('637b3136-e650-47ef-a9fe-492091eb8174', None, None, None, None, None)] {{(pid=126813) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 20 04:52:13.331837 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-e4bab2e6-c7b5-4ac7-9b9c-e82cdd5e25c6 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77211762af4cc9b4f0a2f74ac3ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa7ea3cb69454797bd7956e12f2a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:13.347680 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-e4bab2e6-c7b5-4ac7-9b9c-e82cdd5e25c6 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] 10.222.0.27 "GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7" status: 200 len: 1314 microversion: 2.1 time: 2.291574 Sep 20 04:52:13.351906 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 22/61] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:11 2022] GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7 => generated 1314 bytes in 2297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:13.371690 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-c4719da1-456b-4b93-bf4f-05679d8ebac0 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:13.372497 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-c4719da1-456b-4b93-bf4f-05679d8ebac0 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:13.393753 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-c4719da1-456b-4b93-bf4f-05679d8ebac0 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:13.394455 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-c4719da1-456b-4b93-bf4f-05679d8ebac0 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:13.395338 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-c4719da1-456b-4b93-bf4f-05679d8ebac0 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:13.407963 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-c4719da1-456b-4b93-bf4f-05679d8ebac0 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:13.408624 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-c4719da1-456b-4b93-bf4f-05679d8ebac0 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:13.412278 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-c4719da1-456b-4b93-bf4f-05679d8ebac0 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:13.851816 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-c4719da1-456b-4b93-bf4f-05679d8ebac0 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:13.865121 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-c4719da1-456b-4b93-bf4f-05679d8ebac0 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1280 microversion: 2.1 time: 0.499696 Sep 20 04:52:13.866250 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 23/62] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:13 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1280 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:14.386782 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-a2b909db-7836-476a-b9ff-7056e91137d0 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:14.388128 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-a2b909db-7836-476a-b9ff-7056e91137d0 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] [instance: 033b2f0d-760f-467a-9b3b-e7a8f2196aa7] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:14.397512 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-a2b909db-7836-476a-b9ff-7056e91137d0 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:14.398845 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-a2b909db-7836-476a-b9ff-7056e91137d0 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:14.400392 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-a2b909db-7836-476a-b9ff-7056e91137d0 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:14.402185 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-a2b909db-7836-476a-b9ff-7056e91137d0 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:14.405508 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-a2b909db-7836-476a-b9ff-7056e91137d0 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:14.406169 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-a2b909db-7836-476a-b9ff-7056e91137d0 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:15.684557 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-a2b909db-7836-476a-b9ff-7056e91137d0 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77211762af4cc9b4f0a2f74ac3ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa7ea3cb69454797bd7956e12f2a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:15.701971 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-a2b909db-7836-476a-b9ff-7056e91137d0 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] 10.222.0.27 "GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7" status: 200 len: 1314 microversion: 2.1 time: 1.320349 Sep 20 04:52:15.702634 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 24/63] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:14 2022] GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7 => generated 1314 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:52:15.709032 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-1ec16f24-3982-4730-b3ff-31f0ff1625de tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:15.709646 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-1ec16f24-3982-4730-b3ff-31f0ff1625de tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:15.738134 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-1ec16f24-3982-4730-b3ff-31f0ff1625de tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:15.738625 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-1ec16f24-3982-4730-b3ff-31f0ff1625de tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:15.739065 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-1ec16f24-3982-4730-b3ff-31f0ff1625de tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:15.739783 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-1ec16f24-3982-4730-b3ff-31f0ff1625de tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:15.740216 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-1ec16f24-3982-4730-b3ff-31f0ff1625de tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:15.741001 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-1ec16f24-3982-4730-b3ff-31f0ff1625de tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:16.412294 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-1ec16f24-3982-4730-b3ff-31f0ff1625de tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:16.429494 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG dbcounter [-] [126814] Writing DB stats nova_cell1:SELECT=41 {{(pid=126814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:16.434133 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-1ec16f24-3982-4730-b3ff-31f0ff1625de tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1280 microversion: 2.1 time: 0.730533 Sep 20 04:52:16.435285 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 25/64] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:15 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1280 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:16.828855 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-85bdc726-e209-4f8d-abca-9f9eb3e9fd34 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Flavor limits 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 20 04:52:16.829421 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-85bdc726-e209-4f8d-abca-9f9eb3e9fd34 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Image limits 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 20 04:52:16.829973 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-85bdc726-e209-4f8d-abca-9f9eb3e9fd34 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Flavor pref 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 20 04:52:16.830846 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-85bdc726-e209-4f8d-abca-9f9eb3e9fd34 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Image pref 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 20 04:52:16.831452 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-85bdc726-e209-4f8d-abca-9f9eb3e9fd34 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 20 04:52:16.853187 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:16.888485 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-85bdc726-e209-4f8d-abca-9f9eb3e9fd34 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:16.889607 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-85bdc726-e209-4f8d-abca-9f9eb3e9fd34 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:16.892158 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-85bdc726-e209-4f8d-abca-9f9eb3e9fd34 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:16.893977 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-85bdc726-e209-4f8d-abca-9f9eb3e9fd34 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:16.898145 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-85bdc726-e209-4f8d-abca-9f9eb3e9fd34 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:16.900475 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-85bdc726-e209-4f8d-abca-9f9eb3e9fd34 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:16.985613 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-85bdc726-e209-4f8d-abca-9f9eb3e9fd34 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Getting quotas for project 4f0f0b8842ae496292c27a6ee1350d32. Resources: {'ram', 'cores', 'instances'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 04:52:16.997998 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-85bdc726-e209-4f8d-abca-9f9eb3e9fd34 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Getting quotas for user c93f22104a7b4a7caf0cc8b7180ffc55 and project 4f0f0b8842ae496292c27a6ee1350d32. Resources: {'ram', 'cores', 'instances'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 04:52:17.051700 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-85bdc726-e209-4f8d-abca-9f9eb3e9fd34 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Going to run 1 instances... {{(pid=126813) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 20 04:52:17.066908 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-85bdc726-e209-4f8d-abca-9f9eb3e9fd34 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='080ea053-830e-4470-a886-0ab99b0ab3e0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126813) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 20 04:52:17.089150 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [req-50a1266b-d9e1-4b9f-b260-b90464e1ab9d req-f5f1ce12-a97b-452b-97b2-debdb85a7537 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2", "tag": "e7732f19-361c-4723-a7a3-dd9abf4593ea"}]} {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:52:17.107541 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG dbcounter [-] [126814] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=9 {{(pid=126814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:17.159451 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [req-50a1266b-d9e1-4b9f-b260-b90464e1ab9d req-f5f1ce12-a97b-452b-97b2-debdb85a7537 service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:17.159940 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [req-50a1266b-d9e1-4b9f-b260-b90464e1ab9d req-f5f1ce12-a97b-452b-97b2-debdb85a7537 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:17.164709 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [req-50a1266b-d9e1-4b9f-b260-b90464e1ab9d req-f5f1ce12-a97b-452b-97b2-debdb85a7537 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:17.243801 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.compute.server_external_events [req-50a1266b-d9e1-4b9f-b260-b90464e1ab9d req-f5f1ce12-a97b-452b-97b2-debdb85a7537 service nova] Creating event network-changed:e7732f19-361c-4723-a7a3-dd9abf4593ea for instance 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 on hv-cinder-75671 Sep 20 04:52:17.244827 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [req-50a1266b-d9e1-4b9f-b260-b90464e1ab9d req-f5f1ce12-a97b-452b-97b2-debdb85a7537 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=126814) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 20 04:52:17.246715 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [req-50a1266b-d9e1-4b9f-b260-b90464e1ab9d req-f5f1ce12-a97b-452b-97b2-debdb85a7537 service nova] Acquired lock "compute-rpcapi-router" {{(pid=126814) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 20 04:52:17.247885 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-c4876a68-553f-415e-8c39-c676b46d7071 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:17.248367 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-c4876a68-553f-415e-8c39-c676b46d7071 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:17.249567 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-c4876a68-553f-415e-8c39-c676b46d7071 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:17.250329 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-c4876a68-553f-415e-8c39-c676b46d7071 None None] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:17.250798 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-c4876a68-553f-415e-8c39-c676b46d7071 None None] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:17.252637 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-c4876a68-553f-415e-8c39-c676b46d7071 None None] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:17.297393 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG dbcounter [-] [126814] Writing DB stats nova_cell0:SELECT=7 {{(pid=126814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:17.312351 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.compute.rpcapi [None req-c4876a68-553f-415e-8c39-c676b46d7071 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 20 04:52:17.316555 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-c4876a68-553f-415e-8c39-c676b46d7071 None None] Releasing lock "compute-rpcapi-router" {{(pid=126814) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 20 04:52:17.319649 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-85bdc726-e209-4f8d-abca-9f9eb3e9fd34 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 6.793882 Sep 20 04:52:17.322355 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 40/65] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Sep 20 04:52:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 6798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 20 04:52:17.362081 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-c4876a68-553f-415e-8c39-c676b46d7071 None None] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.925061 Sep 20 04:52:17.365718 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 26/66] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 04:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:52:17.390032 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-730fa81b-7d01-4458-beb4-421fd4029c0f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:17.401668 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-730fa81b-7d01-4458-beb4-421fd4029c0f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] [instance: 033b2f0d-760f-467a-9b3b-e7a8f2196aa7] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:17.428154 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-730fa81b-7d01-4458-beb4-421fd4029c0f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:17.429392 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-730fa81b-7d01-4458-beb4-421fd4029c0f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:17.429848 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-730fa81b-7d01-4458-beb4-421fd4029c0f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:17.431196 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-730fa81b-7d01-4458-beb4-421fd4029c0f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:17.431554 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-730fa81b-7d01-4458-beb4-421fd4029c0f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:17.432065 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-730fa81b-7d01-4458-beb4-421fd4029c0f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:17.515345 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-89117771-0422-4312-b123-be1b0d90e86f req-bc6fd415-1a20-40d5-97c6-8130d0f96dc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "033b2f0d-760f-467a-9b3b-e7a8f2196aa7", "tag": "46aec430-a166-4d48-b4d3-8dc05c3ee484"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:52:17.551727 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-89117771-0422-4312-b123-be1b0d90e86f req-bc6fd415-1a20-40d5-97c6-8130d0f96dc7 service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:17.557468 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-89117771-0422-4312-b123-be1b0d90e86f req-bc6fd415-1a20-40d5-97c6-8130d0f96dc7 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:17.558497 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-89117771-0422-4312-b123-be1b0d90e86f req-bc6fd415-1a20-40d5-97c6-8130d0f96dc7 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:17.621663 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-89117771-0422-4312-b123-be1b0d90e86f req-bc6fd415-1a20-40d5-97c6-8130d0f96dc7 service nova] Creating event network-changed:46aec430-a166-4d48-b4d3-8dc05c3ee484 for instance 033b2f0d-760f-467a-9b3b-e7a8f2196aa7 on hv-cinder-75671 Sep 20 04:52:17.626819 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-89117771-0422-4312-b123-be1b0d90e86f req-bc6fd415-1a20-40d5-97c6-8130d0f96dc7 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=126813) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 20 04:52:17.628480 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-89117771-0422-4312-b123-be1b0d90e86f req-bc6fd415-1a20-40d5-97c6-8130d0f96dc7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=126813) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 20 04:52:17.631335 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-20544607-59a9-461e-bcfb-9a749a0e3fde None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:17.632027 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-20544607-59a9-461e-bcfb-9a749a0e3fde None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:17.633222 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-20544607-59a9-461e-bcfb-9a749a0e3fde None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:17.634953 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-20544607-59a9-461e-bcfb-9a749a0e3fde None None] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:17.636272 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-20544607-59a9-461e-bcfb-9a749a0e3fde None None] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:17.637081 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-20544607-59a9-461e-bcfb-9a749a0e3fde None None] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:17.653237 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.compute.rpcapi [None req-20544607-59a9-461e-bcfb-9a749a0e3fde None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 20 04:52:17.656016 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-20544607-59a9-461e-bcfb-9a749a0e3fde None None] Releasing lock "compute-rpcapi-router" {{(pid=126813) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 20 04:52:17.698745 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-20544607-59a9-461e-bcfb-9a749a0e3fde None None] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.374204 Sep 20 04:52:17.701260 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 41/67] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 04:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:52:17.721056 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-936d7299-664c-4808-a265-cc18a03debc7 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:17.721764 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-936d7299-664c-4808-a265-cc18a03debc7 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:18.115742 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-936d7299-664c-4808-a265-cc18a03debc7 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:18.136352 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-936d7299-664c-4808-a265-cc18a03debc7 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab" status: 200 len: 1242 microversion: 2.1 time: 0.423546 Sep 20 04:52:18.146185 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 42/68] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:17 2022] GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab => generated 1242 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:18.163473 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-66541ddc-1f56-4ffd-a084-a086cf3ac64d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:18.164132 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-66541ddc-1f56-4ffd-a084-a086cf3ac64d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:18.180498 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-66541ddc-1f56-4ffd-a084-a086cf3ac64d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:18.181062 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-66541ddc-1f56-4ffd-a084-a086cf3ac64d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:18.182856 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-66541ddc-1f56-4ffd-a084-a086cf3ac64d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:18.187869 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-66541ddc-1f56-4ffd-a084-a086cf3ac64d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:18.191834 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-66541ddc-1f56-4ffd-a084-a086cf3ac64d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:18.192318 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-66541ddc-1f56-4ffd-a084-a086cf3ac64d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:18.587467 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-730fa81b-7d01-4458-beb4-421fd4029c0f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77211762af4cc9b4f0a2f74ac3ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa7ea3cb69454797bd7956e12f2a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:18.601584 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-730fa81b-7d01-4458-beb4-421fd4029c0f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] 10.222.0.27 "GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7" status: 200 len: 1314 microversion: 2.1 time: 1.231056 Sep 20 04:52:18.604546 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 27/69] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:17 2022] GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7 => generated 1314 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:18.790915 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-66541ddc-1f56-4ffd-a084-a086cf3ac64d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:18.808187 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-66541ddc-1f56-4ffd-a084-a086cf3ac64d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1322 microversion: 2.1 time: 0.649224 Sep 20 04:52:18.809463 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 43/70] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:18 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1322 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:19.169495 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-6b71d25a-cd31-4eef-bdca-0e5c8f6d99a7 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:19.170372 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-6b71d25a-cd31-4eef-bdca-0e5c8f6d99a7 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:19.172918 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG dbcounter [-] [126814] Writing DB stats nova_cell0:SELECT=22 {{(pid=126814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:19.181553 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-6b71d25a-cd31-4eef-bdca-0e5c8f6d99a7 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:19.188399 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-6b71d25a-cd31-4eef-bdca-0e5c8f6d99a7 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:19.190693 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-6b71d25a-cd31-4eef-bdca-0e5c8f6d99a7 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:19.192405 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-6b71d25a-cd31-4eef-bdca-0e5c8f6d99a7 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:19.193799 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-6b71d25a-cd31-4eef-bdca-0e5c8f6d99a7 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:19.195425 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-6b71d25a-cd31-4eef-bdca-0e5c8f6d99a7 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:19.537934 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-6b71d25a-cd31-4eef-bdca-0e5c8f6d99a7 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:19.549858 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-6b71d25a-cd31-4eef-bdca-0e5c8f6d99a7 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab" status: 200 len: 1238 microversion: 2.1 time: 0.386237 Sep 20 04:52:19.568762 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 28/71] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:19 2022] GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab => generated 1238 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:19.631570 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-68c0490e-cc33-4ca1-bb51-29f11aa560d4 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:19.632193 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-68c0490e-cc33-4ca1-bb51-29f11aa560d4 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] [instance: 033b2f0d-760f-467a-9b3b-e7a8f2196aa7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:19.645205 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-68c0490e-cc33-4ca1-bb51-29f11aa560d4 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:19.646850 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-68c0490e-cc33-4ca1-bb51-29f11aa560d4 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:19.647460 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-68c0490e-cc33-4ca1-bb51-29f11aa560d4 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:19.650402 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-68c0490e-cc33-4ca1-bb51-29f11aa560d4 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:19.651109 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-68c0490e-cc33-4ca1-bb51-29f11aa560d4 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:19.654546 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-68c0490e-cc33-4ca1-bb51-29f11aa560d4 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:19.834153 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-d9b3d4a7-994c-4aa8-bae7-c7678750a82d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:19.834742 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-d9b3d4a7-994c-4aa8-bae7-c7678750a82d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:19.843354 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-d9b3d4a7-994c-4aa8-bae7-c7678750a82d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:19.843837 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-d9b3d4a7-994c-4aa8-bae7-c7678750a82d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:19.844268 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-d9b3d4a7-994c-4aa8-bae7-c7678750a82d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:19.850046 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-d9b3d4a7-994c-4aa8-bae7-c7678750a82d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:19.850923 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-d9b3d4a7-994c-4aa8-bae7-c7678750a82d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:19.853409 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-d9b3d4a7-994c-4aa8-bae7-c7678750a82d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:20.052631 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-68c0490e-cc33-4ca1-bb51-29f11aa560d4 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77211762af4cc9b4f0a2f74ac3ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa7ea3cb69454797bd7956e12f2a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:20.065751 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-68c0490e-cc33-4ca1-bb51-29f11aa560d4 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] 10.222.0.27 "GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7" status: 200 len: 1314 microversion: 2.1 time: 0.437654 Sep 20 04:52:20.081992 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 44/72] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:19 2022] GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7 => generated 1314 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:20.144579 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-d9b3d4a7-994c-4aa8-bae7-c7678750a82d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:20.156447 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-d9b3d4a7-994c-4aa8-bae7-c7678750a82d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1322 microversion: 2.1 time: 0.327358 Sep 20 04:52:20.158420 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 29/73] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:19 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1322 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:52:20.207326 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-da843ab0-ae89-4e7d-895c-1872dfb43f15 req-91b5b23d-ba3d-4aa8-975e-0cd5f9fd1ecc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4e85593-565d-40c6-bed2-121ca9466654", "tag": "512e1b53-d964-4c70-8001-91bd16999e8b"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:52:20.230749 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-da843ab0-ae89-4e7d-895c-1872dfb43f15 req-91b5b23d-ba3d-4aa8-975e-0cd5f9fd1ecc service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:20.231241 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-da843ab0-ae89-4e7d-895c-1872dfb43f15 req-91b5b23d-ba3d-4aa8-975e-0cd5f9fd1ecc service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:20.231675 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-da843ab0-ae89-4e7d-895c-1872dfb43f15 req-91b5b23d-ba3d-4aa8-975e-0cd5f9fd1ecc service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:20.263813 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-da843ab0-ae89-4e7d-895c-1872dfb43f15 req-91b5b23d-ba3d-4aa8-975e-0cd5f9fd1ecc service nova] Creating event network-changed:512e1b53-d964-4c70-8001-91bd16999e8b for instance d4e85593-565d-40c6-bed2-121ca9466654 on hv-cinder-75671 Sep 20 04:52:20.275435 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-da843ab0-ae89-4e7d-895c-1872dfb43f15 req-91b5b23d-ba3d-4aa8-975e-0cd5f9fd1ecc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070945 Sep 20 04:52:20.278336 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 45/74] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 04:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:52:20.583429 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-a8f9fb8c-3294-497d-98ed-70bd771df1a0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:20.583963 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-a8f9fb8c-3294-497d-98ed-70bd771df1a0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:20.619337 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-a8f9fb8c-3294-497d-98ed-70bd771df1a0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:20.619848 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-a8f9fb8c-3294-497d-98ed-70bd771df1a0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:20.620368 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-a8f9fb8c-3294-497d-98ed-70bd771df1a0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:20.623287 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-a8f9fb8c-3294-497d-98ed-70bd771df1a0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:20.624366 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-a8f9fb8c-3294-497d-98ed-70bd771df1a0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:20.625416 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-a8f9fb8c-3294-497d-98ed-70bd771df1a0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:20.836367 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-a8f9fb8c-3294-497d-98ed-70bd771df1a0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:20.848551 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-a8f9fb8c-3294-497d-98ed-70bd771df1a0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab" status: 200 len: 1302 microversion: 2.1 time: 0.269009 Sep 20 04:52:20.851660 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 30/75] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:20 2022] GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab => generated 1302 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:21.090063 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-a9bba963-6513-4fa7-9e17-e5c59bbbc875 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:21.090817 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-a9bba963-6513-4fa7-9e17-e5c59bbbc875 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] [instance: 033b2f0d-760f-467a-9b3b-e7a8f2196aa7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:21.101091 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a9bba963-6513-4fa7-9e17-e5c59bbbc875 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:21.101834 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a9bba963-6513-4fa7-9e17-e5c59bbbc875 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:21.103115 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a9bba963-6513-4fa7-9e17-e5c59bbbc875 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:21.104043 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a9bba963-6513-4fa7-9e17-e5c59bbbc875 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:21.104736 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a9bba963-6513-4fa7-9e17-e5c59bbbc875 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:21.105364 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a9bba963-6513-4fa7-9e17-e5c59bbbc875 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:21.181863 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-15c1ad11-3dc7-43af-b67a-4b2a6b435588 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:21.182674 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-15c1ad11-3dc7-43af-b67a-4b2a6b435588 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:21.193492 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-15c1ad11-3dc7-43af-b67a-4b2a6b435588 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:21.193987 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-15c1ad11-3dc7-43af-b67a-4b2a6b435588 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:21.194425 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-15c1ad11-3dc7-43af-b67a-4b2a6b435588 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:21.196409 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-15c1ad11-3dc7-43af-b67a-4b2a6b435588 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:21.196912 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-15c1ad11-3dc7-43af-b67a-4b2a6b435588 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:21.197538 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-15c1ad11-3dc7-43af-b67a-4b2a6b435588 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:21.479766 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-15c1ad11-3dc7-43af-b67a-4b2a6b435588 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:21.490326 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-15c1ad11-3dc7-43af-b67a-4b2a6b435588 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1322 microversion: 2.1 time: 0.312742 Sep 20 04:52:21.497072 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-a9bba963-6513-4fa7-9e17-e5c59bbbc875 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77211762af4cc9b4f0a2f74ac3ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa7ea3cb69454797bd7956e12f2a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:21.507490 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-a9bba963-6513-4fa7-9e17-e5c59bbbc875 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] 10.222.0.27 "GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7" status: 200 len: 1314 microversion: 2.1 time: 0.422050 Sep 20 04:52:21.508993 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 46/76] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:21 2022] GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7 => generated 1314 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:21.511638 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 31/77] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:21 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1322 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:52:21.873903 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-4f433b3d-8ba1-4178-83f4-4759e9a80f92 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:21.874523 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-4f433b3d-8ba1-4178-83f4-4759e9a80f92 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:21.886136 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4f433b3d-8ba1-4178-83f4-4759e9a80f92 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:21.886874 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4f433b3d-8ba1-4178-83f4-4759e9a80f92 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:21.887493 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4f433b3d-8ba1-4178-83f4-4759e9a80f92 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:21.888406 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4f433b3d-8ba1-4178-83f4-4759e9a80f92 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:21.889075 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4f433b3d-8ba1-4178-83f4-4759e9a80f92 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:21.889681 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4f433b3d-8ba1-4178-83f4-4759e9a80f92 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:21.984095 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-4f433b3d-8ba1-4178-83f4-4759e9a80f92 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:21.998369 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-4f433b3d-8ba1-4178-83f4-4759e9a80f92 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab" status: 200 len: 1302 microversion: 2.1 time: 0.127609 Sep 20 04:52:22.007085 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 47/78] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:21 2022] GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab => generated 1302 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:22.519046 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-8955578c-a690-4b0c-a0dd-aa4aee06f8a4 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:22.520228 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-8955578c-a690-4b0c-a0dd-aa4aee06f8a4 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:22.531308 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-8955578c-a690-4b0c-a0dd-aa4aee06f8a4 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:22.532095 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-8955578c-a690-4b0c-a0dd-aa4aee06f8a4 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:22.533228 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-8955578c-a690-4b0c-a0dd-aa4aee06f8a4 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:22.533339 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-a32b262c-9bb3-414b-b0db-c1b23b3b804f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:22.534070 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-a32b262c-9bb3-414b-b0db-c1b23b3b804f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] [instance: 033b2f0d-760f-467a-9b3b-e7a8f2196aa7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:22.534723 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-8955578c-a690-4b0c-a0dd-aa4aee06f8a4 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:22.535183 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-8955578c-a690-4b0c-a0dd-aa4aee06f8a4 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:22.535613 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-8955578c-a690-4b0c-a0dd-aa4aee06f8a4 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:22.541610 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a32b262c-9bb3-414b-b0db-c1b23b3b804f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:22.543209 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a32b262c-9bb3-414b-b0db-c1b23b3b804f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:22.543657 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a32b262c-9bb3-414b-b0db-c1b23b3b804f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:22.544518 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a32b262c-9bb3-414b-b0db-c1b23b3b804f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:22.545266 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a32b262c-9bb3-414b-b0db-c1b23b3b804f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:22.545707 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a32b262c-9bb3-414b-b0db-c1b23b3b804f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:22.771309 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-8955578c-a690-4b0c-a0dd-aa4aee06f8a4 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:22.783675 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-a32b262c-9bb3-414b-b0db-c1b23b3b804f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77211762af4cc9b4f0a2f74ac3ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa7ea3cb69454797bd7956e12f2a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:22.785095 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-8955578c-a690-4b0c-a0dd-aa4aee06f8a4 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1322 microversion: 2.1 time: 0.270376 Sep 20 04:52:22.785684 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 32/79] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:22 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1322 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:22.796279 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-a32b262c-9bb3-414b-b0db-c1b23b3b804f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] 10.222.0.27 "GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7" status: 200 len: 1314 microversion: 2.1 time: 0.267205 Sep 20 04:52:22.800982 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 48/80] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:22 2022] GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:52:23.022536 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-685f296e-448f-4013-8c99-835f058f7c65 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:23.023331 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-685f296e-448f-4013-8c99-835f058f7c65 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:23.029347 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-685f296e-448f-4013-8c99-835f058f7c65 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:23.030057 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-685f296e-448f-4013-8c99-835f058f7c65 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:23.030255 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-685f296e-448f-4013-8c99-835f058f7c65 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:23.031116 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-685f296e-448f-4013-8c99-835f058f7c65 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:23.031566 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-685f296e-448f-4013-8c99-835f058f7c65 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:23.031991 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-685f296e-448f-4013-8c99-835f058f7c65 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:23.103387 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-685f296e-448f-4013-8c99-835f058f7c65 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:23.111911 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-685f296e-448f-4013-8c99-835f058f7c65 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab" status: 200 len: 1302 microversion: 2.1 time: 0.094274 Sep 20 04:52:23.112457 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 33/81] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:23 2022] GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab => generated 1302 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:52:23.811696 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-32f9eada-f957-4388-a1ba-303929fa60d8 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:23.812663 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-32f9eada-f957-4388-a1ba-303929fa60d8 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:23.818997 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-32f9eada-f957-4388-a1ba-303929fa60d8 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:23.819616 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-32f9eada-f957-4388-a1ba-303929fa60d8 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:23.820646 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-32f9eada-f957-4388-a1ba-303929fa60d8 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:23.821515 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-32f9eada-f957-4388-a1ba-303929fa60d8 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:23.822167 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-32f9eada-f957-4388-a1ba-303929fa60d8 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:23.822786 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-32f9eada-f957-4388-a1ba-303929fa60d8 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:23.826190 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-8fecce7f-61f6-422f-9645-a432f9150f85 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:23.826805 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-8fecce7f-61f6-422f-9645-a432f9150f85 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] [instance: 033b2f0d-760f-467a-9b3b-e7a8f2196aa7] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:23.835327 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-8fecce7f-61f6-422f-9645-a432f9150f85 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:23.835816 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-8fecce7f-61f6-422f-9645-a432f9150f85 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:23.836243 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-8fecce7f-61f6-422f-9645-a432f9150f85 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:23.837003 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-8fecce7f-61f6-422f-9645-a432f9150f85 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:23.837607 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-8fecce7f-61f6-422f-9645-a432f9150f85 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:23.838176 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-8fecce7f-61f6-422f-9645-a432f9150f85 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:24.029997 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-32f9eada-f957-4388-a1ba-303929fa60d8 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:24.038749 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-32f9eada-f957-4388-a1ba-303929fa60d8 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1322 microversion: 2.1 time: 0.231737 Sep 20 04:52:24.040042 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 49/82] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:23 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:24.045927 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-8fecce7f-61f6-422f-9645-a432f9150f85 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77211762af4cc9b4f0a2f74ac3ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa7ea3cb69454797bd7956e12f2a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:24.053790 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-8fecce7f-61f6-422f-9645-a432f9150f85 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] 10.222.0.27 "GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7" status: 200 len: 1314 microversion: 2.1 time: 0.232247 Sep 20 04:52:24.054355 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 34/83] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:23 2022] GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:52:24.135239 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-890e1e5a-6c93-473d-a144-a26a185ae5f3 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:24.135844 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-890e1e5a-6c93-473d-a144-a26a185ae5f3 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:24.141995 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-890e1e5a-6c93-473d-a144-a26a185ae5f3 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:24.142468 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-890e1e5a-6c93-473d-a144-a26a185ae5f3 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:24.143056 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-890e1e5a-6c93-473d-a144-a26a185ae5f3 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:24.143921 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-890e1e5a-6c93-473d-a144-a26a185ae5f3 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:24.144514 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-890e1e5a-6c93-473d-a144-a26a185ae5f3 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:24.145093 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-890e1e5a-6c93-473d-a144-a26a185ae5f3 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:24.210538 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-890e1e5a-6c93-473d-a144-a26a185ae5f3 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:24.220348 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-890e1e5a-6c93-473d-a144-a26a185ae5f3 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab" status: 200 len: 1302 microversion: 2.1 time: 0.088844 Sep 20 04:52:24.229226 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 50/84] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:24 2022] GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab => generated 1302 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:25.061807 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-c666f033-96ca-4fa3-a4ea-c32e552caa22 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:25.062419 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-c666f033-96ca-4fa3-a4ea-c32e552caa22 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:25.069054 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-c666f033-96ca-4fa3-a4ea-c32e552caa22 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:25.069535 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-c666f033-96ca-4fa3-a4ea-c32e552caa22 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:25.069979 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-c666f033-96ca-4fa3-a4ea-c32e552caa22 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:25.070658 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-c666f033-96ca-4fa3-a4ea-c32e552caa22 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:25.071101 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-c666f033-96ca-4fa3-a4ea-c32e552caa22 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:25.071521 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-c666f033-96ca-4fa3-a4ea-c32e552caa22 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:25.081977 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-a583a82c-5924-4c6e-aa2d-9ab27ae08c1c tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:25.083152 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-a583a82c-5924-4c6e-aa2d-9ab27ae08c1c tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] [instance: 033b2f0d-760f-467a-9b3b-e7a8f2196aa7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:25.094642 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a583a82c-5924-4c6e-aa2d-9ab27ae08c1c tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:25.095491 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a583a82c-5924-4c6e-aa2d-9ab27ae08c1c tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:25.096190 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a583a82c-5924-4c6e-aa2d-9ab27ae08c1c tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:25.097418 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a583a82c-5924-4c6e-aa2d-9ab27ae08c1c tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:25.098165 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a583a82c-5924-4c6e-aa2d-9ab27ae08c1c tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:25.098896 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a583a82c-5924-4c6e-aa2d-9ab27ae08c1c tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:25.283010 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-c666f033-96ca-4fa3-a4ea-c32e552caa22 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:25.291294 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-c666f033-96ca-4fa3-a4ea-c32e552caa22 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1322 microversion: 2.1 time: 0.233082 Sep 20 04:52:25.292360 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 35/85] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:25 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:25.297080 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-ed35bd4f-6b7c-48d3-9dbe-1dcd31869ab4 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:25.297674 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-ed35bd4f-6b7c-48d3-9dbe-1dcd31869ab4 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:25.304103 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-ed35bd4f-6b7c-48d3-9dbe-1dcd31869ab4 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:25.304578 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-ed35bd4f-6b7c-48d3-9dbe-1dcd31869ab4 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:25.305058 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-ed35bd4f-6b7c-48d3-9dbe-1dcd31869ab4 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:25.305910 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-ed35bd4f-6b7c-48d3-9dbe-1dcd31869ab4 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:25.306503 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-ed35bd4f-6b7c-48d3-9dbe-1dcd31869ab4 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:25.307063 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-ed35bd4f-6b7c-48d3-9dbe-1dcd31869ab4 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:25.318094 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-a583a82c-5924-4c6e-aa2d-9ab27ae08c1c tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77211762af4cc9b4f0a2f74ac3ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa7ea3cb69454797bd7956e12f2a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:25.330780 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-a583a82c-5924-4c6e-aa2d-9ab27ae08c1c tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] 10.222.0.27 "GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7" status: 200 len: 1314 microversion: 2.1 time: 0.256145 Sep 20 04:52:25.332001 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 51/86] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:25 2022] GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:25.372899 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-ed35bd4f-6b7c-48d3-9dbe-1dcd31869ab4 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:25.380890 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-ed35bd4f-6b7c-48d3-9dbe-1dcd31869ab4 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab" status: 200 len: 1302 microversion: 2.1 time: 0.087284 Sep 20 04:52:25.381454 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 36/87] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:25 2022] GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab => generated 1302 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:26.316456 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-4e3692cd-2e64-4a6b-851c-1e9377ed1cf3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:26.317088 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-4e3692cd-2e64-4a6b-851c-1e9377ed1cf3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:26.323597 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4e3692cd-2e64-4a6b-851c-1e9377ed1cf3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:26.324082 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4e3692cd-2e64-4a6b-851c-1e9377ed1cf3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:26.324525 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4e3692cd-2e64-4a6b-851c-1e9377ed1cf3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:26.325242 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4e3692cd-2e64-4a6b-851c-1e9377ed1cf3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:26.325697 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4e3692cd-2e64-4a6b-851c-1e9377ed1cf3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:26.326127 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4e3692cd-2e64-4a6b-851c-1e9377ed1cf3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:26.354067 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-6f74f3aa-8dc3-4900-bd01-c1dad9dc56e1 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:26.354661 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-6f74f3aa-8dc3-4900-bd01-c1dad9dc56e1 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] [instance: 033b2f0d-760f-467a-9b3b-e7a8f2196aa7] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:26.360580 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-6f74f3aa-8dc3-4900-bd01-c1dad9dc56e1 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:26.361083 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-6f74f3aa-8dc3-4900-bd01-c1dad9dc56e1 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:26.361510 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-6f74f3aa-8dc3-4900-bd01-c1dad9dc56e1 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:26.362217 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-6f74f3aa-8dc3-4900-bd01-c1dad9dc56e1 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:26.362659 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-6f74f3aa-8dc3-4900-bd01-c1dad9dc56e1 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:26.363073 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-6f74f3aa-8dc3-4900-bd01-c1dad9dc56e1 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:26.510167 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-4e3692cd-2e64-4a6b-851c-1e9377ed1cf3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:26.512453 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell1:SELECT=97 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:26.519212 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-4e3692cd-2e64-4a6b-851c-1e9377ed1cf3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1322 microversion: 2.1 time: 0.206633 Sep 20 04:52:26.519787 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 52/88] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:26 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:26.525306 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-051f0c26-c3e9-4ee2-9605-fa5c8422d015 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:26.525915 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-051f0c26-c3e9-4ee2-9605-fa5c8422d015 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:26.531742 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-051f0c26-c3e9-4ee2-9605-fa5c8422d015 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:26.532387 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-051f0c26-c3e9-4ee2-9605-fa5c8422d015 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:26.533023 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-051f0c26-c3e9-4ee2-9605-fa5c8422d015 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:26.533864 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-051f0c26-c3e9-4ee2-9605-fa5c8422d015 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:26.534051 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-6f74f3aa-8dc3-4900-bd01-c1dad9dc56e1 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77211762af4cc9b4f0a2f74ac3ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa7ea3cb69454797bd7956e12f2a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:26.534629 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-051f0c26-c3e9-4ee2-9605-fa5c8422d015 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:26.535200 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-051f0c26-c3e9-4ee2-9605-fa5c8422d015 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:26.542522 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-6f74f3aa-8dc3-4900-bd01-c1dad9dc56e1 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] 10.222.0.27 "GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7" status: 200 len: 1314 microversion: 2.1 time: 0.192224 Sep 20 04:52:26.543084 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 37/89] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:26 2022] GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:52:26.595983 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-051f0c26-c3e9-4ee2-9605-fa5c8422d015 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:26.604101 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-051f0c26-c3e9-4ee2-9605-fa5c8422d015 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab" status: 200 len: 1302 microversion: 2.1 time: 0.082838 Sep 20 04:52:26.604695 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 53/90] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:26 2022] GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab => generated 1302 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:27.543087 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-4985d26f-9985-4eb6-ac37-2f587b4c9aee tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:27.543689 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-4985d26f-9985-4eb6-ac37-2f587b4c9aee tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:27.545543 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG dbcounter [-] [126814] Writing DB stats nova_cell0:SELECT=1 {{(pid=126814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:27.550913 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-4985d26f-9985-4eb6-ac37-2f587b4c9aee tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:27.551387 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-4985d26f-9985-4eb6-ac37-2f587b4c9aee tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:27.551816 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-4985d26f-9985-4eb6-ac37-2f587b4c9aee tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:27.552497 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-4985d26f-9985-4eb6-ac37-2f587b4c9aee tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:27.552970 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-4985d26f-9985-4eb6-ac37-2f587b4c9aee tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:27.553390 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-4985d26f-9985-4eb6-ac37-2f587b4c9aee tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:27.565757 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-6c919d75-dddd-4dac-9a71-87c88b6e870f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:27.566383 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-6c919d75-dddd-4dac-9a71-87c88b6e870f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] [instance: 033b2f0d-760f-467a-9b3b-e7a8f2196aa7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:27.573102 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6c919d75-dddd-4dac-9a71-87c88b6e870f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:27.573590 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6c919d75-dddd-4dac-9a71-87c88b6e870f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:27.574034 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6c919d75-dddd-4dac-9a71-87c88b6e870f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:27.574732 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6c919d75-dddd-4dac-9a71-87c88b6e870f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:27.575178 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6c919d75-dddd-4dac-9a71-87c88b6e870f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:27.575664 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6c919d75-dddd-4dac-9a71-87c88b6e870f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:27.650999 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell0:SELECT=4 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:27.930652 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-4985d26f-9985-4eb6-ac37-2f587b4c9aee tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:27.939386 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-4985d26f-9985-4eb6-ac37-2f587b4c9aee tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1322 microversion: 2.1 time: 0.400586 Sep 20 04:52:27.940083 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 38/91] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:27 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1322 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:27.946105 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-47c22508-172e-4a9e-a786-f9670b588c9d tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:27.946954 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-47c22508-172e-4a9e-a786-f9670b588c9d tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:27.954009 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-47c22508-172e-4a9e-a786-f9670b588c9d tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:27.954635 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-47c22508-172e-4a9e-a786-f9670b588c9d tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:27.955492 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-47c22508-172e-4a9e-a786-f9670b588c9d tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:27.956350 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-47c22508-172e-4a9e-a786-f9670b588c9d tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:27.956480 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-6c919d75-dddd-4dac-9a71-87c88b6e870f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77211762af4cc9b4f0a2f74ac3ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa7ea3cb69454797bd7956e12f2a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:27.956837 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-47c22508-172e-4a9e-a786-f9670b588c9d tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:27.957253 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-47c22508-172e-4a9e-a786-f9670b588c9d tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:27.972744 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-6c919d75-dddd-4dac-9a71-87c88b6e870f tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] 10.222.0.27 "GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7" status: 200 len: 1314 microversion: 2.1 time: 0.411071 Sep 20 04:52:27.974093 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 54/92] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:27 2022] GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7 => generated 1314 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:28.076397 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-47c22508-172e-4a9e-a786-f9670b588c9d tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:28.088490 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-47c22508-172e-4a9e-a786-f9670b588c9d tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab" status: 200 len: 1300 microversion: 2.1 time: 0.146842 Sep 20 04:52:28.091368 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 39/93] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:27 2022] GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab => generated 1300 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:28.963088 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-6666c8ee-f0ed-4507-b538-19b4984d0309 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:28.964454 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-6666c8ee-f0ed-4507-b538-19b4984d0309 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:28.986654 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell0:SELECT=8 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:28.989148 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6666c8ee-f0ed-4507-b538-19b4984d0309 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:28.989828 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6666c8ee-f0ed-4507-b538-19b4984d0309 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:28.990415 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6666c8ee-f0ed-4507-b538-19b4984d0309 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:28.991283 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6666c8ee-f0ed-4507-b538-19b4984d0309 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:28.991862 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6666c8ee-f0ed-4507-b538-19b4984d0309 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:28.993216 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6666c8ee-f0ed-4507-b538-19b4984d0309 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:29.001576 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-9d46bff5-43f8-4e39-96ee-381bc9e9c841 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:29.002190 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-9d46bff5-43f8-4e39-96ee-381bc9e9c841 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] [instance: 033b2f0d-760f-467a-9b3b-e7a8f2196aa7] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:29.010561 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-9d46bff5-43f8-4e39-96ee-381bc9e9c841 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:29.011053 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-9d46bff5-43f8-4e39-96ee-381bc9e9c841 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:29.011478 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-9d46bff5-43f8-4e39-96ee-381bc9e9c841 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:29.012342 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-9d46bff5-43f8-4e39-96ee-381bc9e9c841 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:29.012983 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-9d46bff5-43f8-4e39-96ee-381bc9e9c841 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:29.013668 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-9d46bff5-43f8-4e39-96ee-381bc9e9c841 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:29.344546 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-9d46bff5-43f8-4e39-96ee-381bc9e9c841 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77211762af4cc9b4f0a2f74ac3ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa7ea3cb69454797bd7956e12f2a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:29.353833 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-9d46bff5-43f8-4e39-96ee-381bc9e9c841 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] 10.222.0.27 "GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7" status: 200 len: 1314 microversion: 2.1 time: 0.355871 Sep 20 04:52:29.364777 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 40/94] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:28 2022] GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7 => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:52:29.364777 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-3f652ae8-8219-45cb-8f2c-8b700d4a2296 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:29.364777 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-3f652ae8-8219-45cb-8f2c-8b700d4a2296 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:29.366084 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-3f652ae8-8219-45cb-8f2c-8b700d4a2296 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:29.366602 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-3f652ae8-8219-45cb-8f2c-8b700d4a2296 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:29.367072 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-3f652ae8-8219-45cb-8f2c-8b700d4a2296 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:29.367817 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-3f652ae8-8219-45cb-8f2c-8b700d4a2296 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:29.368243 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-6666c8ee-f0ed-4507-b538-19b4984d0309 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:29.368365 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-3f652ae8-8219-45cb-8f2c-8b700d4a2296 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:29.368729 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-3f652ae8-8219-45cb-8f2c-8b700d4a2296 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:29.381593 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-6666c8ee-f0ed-4507-b538-19b4984d0309 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1322 microversion: 2.1 time: 0.422298 Sep 20 04:52:29.382176 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 55/95] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:28 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1322 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:29.501644 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-3f652ae8-8219-45cb-8f2c-8b700d4a2296 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:29.510197 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-3f652ae8-8219-45cb-8f2c-8b700d4a2296 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab" status: 200 len: 1368 microversion: 2.1 time: 0.154547 Sep 20 04:52:29.510790 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 41/96] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:29 2022] GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:30.380138 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-795c551f-d610-439c-88d9-da6cee943bde tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:30.380778 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-795c551f-d610-439c-88d9-da6cee943bde tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] [instance: 033b2f0d-760f-467a-9b3b-e7a8f2196aa7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:30.387351 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-795c551f-d610-439c-88d9-da6cee943bde tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:30.387825 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-795c551f-d610-439c-88d9-da6cee943bde tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:30.388253 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-795c551f-d610-439c-88d9-da6cee943bde tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:30.388957 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-795c551f-d610-439c-88d9-da6cee943bde tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:30.389401 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-795c551f-d610-439c-88d9-da6cee943bde tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:30.389818 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-795c551f-d610-439c-88d9-da6cee943bde tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:30.404545 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-394d692b-28ab-4ef5-b4c6-904854edd36b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:30.405266 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-394d692b-28ab-4ef5-b4c6-904854edd36b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:30.411121 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-394d692b-28ab-4ef5-b4c6-904854edd36b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:30.411603 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-394d692b-28ab-4ef5-b4c6-904854edd36b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:30.412042 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-394d692b-28ab-4ef5-b4c6-904854edd36b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:30.412770 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-394d692b-28ab-4ef5-b4c6-904854edd36b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:30.413224 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-394d692b-28ab-4ef5-b4c6-904854edd36b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:30.413678 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-394d692b-28ab-4ef5-b4c6-904854edd36b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:30.580893 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-795c551f-d610-439c-88d9-da6cee943bde tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77211762af4cc9b4f0a2f74ac3ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa7ea3cb69454797bd7956e12f2a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:30.589360 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-795c551f-d610-439c-88d9-da6cee943bde tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] 10.222.0.27 "GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7" status: 200 len: 1314 microversion: 2.1 time: 0.212881 Sep 20 04:52:30.590595 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 56/97] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:30 2022] GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:30.593906 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-394d692b-28ab-4ef5-b4c6-904854edd36b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:30.594858 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-721ef03f-e805-481d-b37e-f81bc7f3efef tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:30.595456 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-721ef03f-e805-481d-b37e-f81bc7f3efef tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:30.596937 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG dbcounter [-] [126814] Writing DB stats nova_cell1:SELECT=100 {{(pid=126814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:30.601530 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-721ef03f-e805-481d-b37e-f81bc7f3efef tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:30.602507 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-721ef03f-e805-481d-b37e-f81bc7f3efef tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:30.603101 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-721ef03f-e805-481d-b37e-f81bc7f3efef tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:30.603782 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-721ef03f-e805-481d-b37e-f81bc7f3efef tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:30.604225 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-721ef03f-e805-481d-b37e-f81bc7f3efef tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:30.604659 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-721ef03f-e805-481d-b37e-f81bc7f3efef tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:30.606288 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-394d692b-28ab-4ef5-b4c6-904854edd36b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1322 microversion: 2.1 time: 0.205635 Sep 20 04:52:30.607009 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 42/98] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:30 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:52:30.735853 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-721ef03f-e805-481d-b37e-f81bc7f3efef tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:30.744463 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-721ef03f-e805-481d-b37e-f81bc7f3efef tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab" status: 200 len: 1368 microversion: 2.1 time: 0.153189 Sep 20 04:52:30.745057 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 57/99] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:30 2022] GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:31.612397 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-902667a7-8bcd-40e8-a5f5-1bdea0aa10fc tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:31.613037 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-902667a7-8bcd-40e8-a5f5-1bdea0aa10fc tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] [instance: 033b2f0d-760f-467a-9b3b-e7a8f2196aa7] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:31.619476 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-902667a7-8bcd-40e8-a5f5-1bdea0aa10fc tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:31.619948 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-902667a7-8bcd-40e8-a5f5-1bdea0aa10fc tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:31.620372 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-902667a7-8bcd-40e8-a5f5-1bdea0aa10fc tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:31.621076 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-902667a7-8bcd-40e8-a5f5-1bdea0aa10fc tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:31.621520 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-902667a7-8bcd-40e8-a5f5-1bdea0aa10fc tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:31.621935 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-902667a7-8bcd-40e8-a5f5-1bdea0aa10fc tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:31.628982 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-92844e81-d7d8-4a19-8719-6cc6c34c7ec7 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:31.629620 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-92844e81-d7d8-4a19-8719-6cc6c34c7ec7 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:31.636140 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-92844e81-d7d8-4a19-8719-6cc6c34c7ec7 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:31.636641 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-92844e81-d7d8-4a19-8719-6cc6c34c7ec7 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:31.637086 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-92844e81-d7d8-4a19-8719-6cc6c34c7ec7 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:31.637773 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-92844e81-d7d8-4a19-8719-6cc6c34c7ec7 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:31.638225 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-92844e81-d7d8-4a19-8719-6cc6c34c7ec7 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:31.638650 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-92844e81-d7d8-4a19-8719-6cc6c34c7ec7 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:31.831755 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-902667a7-8bcd-40e8-a5f5-1bdea0aa10fc tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77211762af4cc9b4f0a2f74ac3ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa7ea3cb69454797bd7956e12f2a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:31.837123 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-92844e81-d7d8-4a19-8719-6cc6c34c7ec7 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:31.847769 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-92844e81-d7d8-4a19-8719-6cc6c34c7ec7 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1322 microversion: 2.1 time: 0.222424 Sep 20 04:52:31.869591 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-902667a7-8bcd-40e8-a5f5-1bdea0aa10fc tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] 10.222.0.27 "GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7" status: 200 len: 1314 microversion: 2.1 time: 0.259746 Sep 20 04:52:31.869591 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 43/100] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:31 2022] GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:31.870422 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 58/101] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:31 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1322 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:52:31.879610 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-cecd21b8-214b-4416-a42c-a89528004b36 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:31.880291 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-cecd21b8-214b-4416-a42c-a89528004b36 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:31.886317 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-cecd21b8-214b-4416-a42c-a89528004b36 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:31.887152 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-cecd21b8-214b-4416-a42c-a89528004b36 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:31.888054 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-cecd21b8-214b-4416-a42c-a89528004b36 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:31.888856 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-cecd21b8-214b-4416-a42c-a89528004b36 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:31.889471 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-cecd21b8-214b-4416-a42c-a89528004b36 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:31.889908 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-cecd21b8-214b-4416-a42c-a89528004b36 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:32.029638 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-cecd21b8-214b-4416-a42c-a89528004b36 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:32.038741 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-cecd21b8-214b-4416-a42c-a89528004b36 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab" status: 200 len: 1368 microversion: 2.1 time: 0.168675 Sep 20 04:52:32.039423 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 44/102] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:31 2022] GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:32.325189 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-946d13de-061a-411d-ae49-1be26582081d req-fd77ca2a-869a-451f-bf77-5687abf850c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2", "name": "network-vif-plugged", "status": "completed", "tag": "e7732f19-361c-4723-a7a3-dd9abf4593ea"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:52:32.334652 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-946d13de-061a-411d-ae49-1be26582081d req-fd77ca2a-869a-451f-bf77-5687abf850c0 service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:32.335121 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-946d13de-061a-411d-ae49-1be26582081d req-fd77ca2a-869a-451f-bf77-5687abf850c0 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:32.335548 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-946d13de-061a-411d-ae49-1be26582081d req-fd77ca2a-869a-451f-bf77-5687abf850c0 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:32.347686 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-946d13de-061a-411d-ae49-1be26582081d req-fd77ca2a-869a-451f-bf77-5687abf850c0 service nova] Creating event network-vif-plugged:e7732f19-361c-4723-a7a3-dd9abf4593ea for instance 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 on hv-cinder-75671 Sep 20 04:52:32.353346 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-946d13de-061a-411d-ae49-1be26582081d req-fd77ca2a-869a-451f-bf77-5687abf850c0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096180 Sep 20 04:52:32.354016 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 59/103] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 04:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 04:52:32.870605 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-6540752d-28a6-4d00-bf12-8d5f80c35c0b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:32.871723 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-6540752d-28a6-4d00-bf12-8d5f80c35c0b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:32.880331 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-6540752d-28a6-4d00-bf12-8d5f80c35c0b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:32.881022 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-6540752d-28a6-4d00-bf12-8d5f80c35c0b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:32.881631 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-6540752d-28a6-4d00-bf12-8d5f80c35c0b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:32.882484 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-6540752d-28a6-4d00-bf12-8d5f80c35c0b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:32.883667 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-6540752d-28a6-4d00-bf12-8d5f80c35c0b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:32.884237 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-6540752d-28a6-4d00-bf12-8d5f80c35c0b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:32.892308 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-0d4c292f-7a8a-4078-9d5f-897a6eb3a939 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:32.893757 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-0d4c292f-7a8a-4078-9d5f-897a6eb3a939 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] [instance: 033b2f0d-760f-467a-9b3b-e7a8f2196aa7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:32.910583 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0d4c292f-7a8a-4078-9d5f-897a6eb3a939 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:32.911089 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0d4c292f-7a8a-4078-9d5f-897a6eb3a939 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:32.911527 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0d4c292f-7a8a-4078-9d5f-897a6eb3a939 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:32.912234 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0d4c292f-7a8a-4078-9d5f-897a6eb3a939 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:32.912709 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0d4c292f-7a8a-4078-9d5f-897a6eb3a939 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:32.914884 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0d4c292f-7a8a-4078-9d5f-897a6eb3a939 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:33.436541 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-0d4c292f-7a8a-4078-9d5f-897a6eb3a939 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77211762af4cc9b4f0a2f74ac3ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa7ea3cb69454797bd7956e12f2a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:33.455394 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-0d4c292f-7a8a-4078-9d5f-897a6eb3a939 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] 10.222.0.27 "GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7" status: 200 len: 1314 microversion: 2.1 time: 0.566183 Sep 20 04:52:33.469665 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 60/104] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:32 2022] GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7 => generated 1314 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:33.489051 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-6540752d-28a6-4d00-bf12-8d5f80c35c0b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:33.499599 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-6386077b-0dec-49c0-bf71-c2b0394f175a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:33.501627 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-6386077b-0dec-49c0-bf71-c2b0394f175a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:33.503648 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-6540752d-28a6-4d00-bf12-8d5f80c35c0b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1322 microversion: 2.1 time: 0.636392 Sep 20 04:52:33.506028 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 45/105] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:32 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1322 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:33.568454 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6386077b-0dec-49c0-bf71-c2b0394f175a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:33.574414 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6386077b-0dec-49c0-bf71-c2b0394f175a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:33.575647 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6386077b-0dec-49c0-bf71-c2b0394f175a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:33.577349 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6386077b-0dec-49c0-bf71-c2b0394f175a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:33.578236 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6386077b-0dec-49c0-bf71-c2b0394f175a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:33.578918 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6386077b-0dec-49c0-bf71-c2b0394f175a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:33.940789 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-6386077b-0dec-49c0-bf71-c2b0394f175a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:33.953184 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-6386077b-0dec-49c0-bf71-c2b0394f175a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab" status: 200 len: 1368 microversion: 2.1 time: 0.482160 Sep 20 04:52:33.956011 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 61/106] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:33 2022] GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab => generated 1368 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:34.145781 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [req-22909ab8-dd19-43fc-b4a6-fcef8c747d73 req-f2dfa1e2-a4eb-40a8-a503-24aad5a12f2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7723784c-51e5-4936-b33a-caf9b1b87bab", "tag": "4e821eae-4814-40c5-b31f-2ea37b73d8f1"}]} {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:52:34.156442 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [req-22909ab8-dd19-43fc-b4a6-fcef8c747d73 req-f2dfa1e2-a4eb-40a8-a503-24aad5a12f2b service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:34.157129 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [req-22909ab8-dd19-43fc-b4a6-fcef8c747d73 req-f2dfa1e2-a4eb-40a8-a503-24aad5a12f2b service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:34.157691 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [req-22909ab8-dd19-43fc-b4a6-fcef8c747d73 req-f2dfa1e2-a4eb-40a8-a503-24aad5a12f2b service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:34.172684 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.compute.server_external_events [req-22909ab8-dd19-43fc-b4a6-fcef8c747d73 req-f2dfa1e2-a4eb-40a8-a503-24aad5a12f2b service nova] Creating event network-changed:4e821eae-4814-40c5-b31f-2ea37b73d8f1 for instance 7723784c-51e5-4936-b33a-caf9b1b87bab on hv-cinder-75671 Sep 20 04:52:34.178016 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [req-22909ab8-dd19-43fc-b4a6-fcef8c747d73 req-f2dfa1e2-a4eb-40a8-a503-24aad5a12f2b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062708 Sep 20 04:52:34.178557 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 46/107] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 04:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:52:34.368825 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-6737d4cb-1fea-42dc-acfc-160c4f4bf0bf req-e842d87c-ac9e-470c-b5e9-4581d95891ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "033b2f0d-760f-467a-9b3b-e7a8f2196aa7", "name": "network-vif-plugged", "status": "completed", "tag": "46aec430-a166-4d48-b4d3-8dc05c3ee484"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:52:34.378492 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-6737d4cb-1fea-42dc-acfc-160c4f4bf0bf req-e842d87c-ac9e-470c-b5e9-4581d95891ea service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:34.379003 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-6737d4cb-1fea-42dc-acfc-160c4f4bf0bf req-e842d87c-ac9e-470c-b5e9-4581d95891ea service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:34.379425 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-6737d4cb-1fea-42dc-acfc-160c4f4bf0bf req-e842d87c-ac9e-470c-b5e9-4581d95891ea service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:34.391540 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-6737d4cb-1fea-42dc-acfc-160c4f4bf0bf req-e842d87c-ac9e-470c-b5e9-4581d95891ea service nova] Creating event network-vif-plugged:46aec430-a166-4d48-b4d3-8dc05c3ee484 for instance 033b2f0d-760f-467a-9b3b-e7a8f2196aa7 on hv-cinder-75671 Sep 20 04:52:34.397451 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-6737d4cb-1fea-42dc-acfc-160c4f4bf0bf req-e842d87c-ac9e-470c-b5e9-4581d95891ea service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033104 Sep 20 04:52:34.397982 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 62/108] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 04:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:52:34.500999 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-a344d22d-4252-483f-8bad-8edc537a883e tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:34.502900 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-a344d22d-4252-483f-8bad-8edc537a883e tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] [instance: 033b2f0d-760f-467a-9b3b-e7a8f2196aa7] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:34.512036 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-a344d22d-4252-483f-8bad-8edc537a883e tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:34.512536 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-a344d22d-4252-483f-8bad-8edc537a883e tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:34.513033 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-a344d22d-4252-483f-8bad-8edc537a883e tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:34.514214 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-a344d22d-4252-483f-8bad-8edc537a883e tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:34.514679 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-a344d22d-4252-483f-8bad-8edc537a883e tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:34.515104 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-a344d22d-4252-483f-8bad-8edc537a883e tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:34.530310 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-a0448875-1b99-46d5-a28b-160c8e64ac38 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:34.531305 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-a0448875-1b99-46d5-a28b-160c8e64ac38 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:34.543599 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a0448875-1b99-46d5-a28b-160c8e64ac38 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:34.544088 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a0448875-1b99-46d5-a28b-160c8e64ac38 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:34.544519 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a0448875-1b99-46d5-a28b-160c8e64ac38 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:34.545392 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a0448875-1b99-46d5-a28b-160c8e64ac38 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:34.545995 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a0448875-1b99-46d5-a28b-160c8e64ac38 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:34.546421 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a0448875-1b99-46d5-a28b-160c8e64ac38 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:34.727383 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-a344d22d-4252-483f-8bad-8edc537a883e tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77211762af4cc9b4f0a2f74ac3ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa7ea3cb69454797bd7956e12f2a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:34.735339 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-a344d22d-4252-483f-8bad-8edc537a883e tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] 10.222.0.27 "GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7" status: 200 len: 1314 microversion: 2.1 time: 0.241287 Sep 20 04:52:34.748628 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 47/109] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:34 2022] GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:34.749631 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-a0448875-1b99-46d5-a28b-160c8e64ac38 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:34.757399 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-a0448875-1b99-46d5-a28b-160c8e64ac38 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1322 microversion: 2.1 time: 0.231464 Sep 20 04:52:34.757999 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 63/110] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:34 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:34.979302 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-e60aecf6-ae87-4477-ada2-90101cae3472 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:34.979836 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-e60aecf6-ae87-4477-ada2-90101cae3472 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:34.985847 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-e60aecf6-ae87-4477-ada2-90101cae3472 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:34.986321 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-e60aecf6-ae87-4477-ada2-90101cae3472 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:34.986750 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-e60aecf6-ae87-4477-ada2-90101cae3472 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:34.987424 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-e60aecf6-ae87-4477-ada2-90101cae3472 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:34.987865 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-e60aecf6-ae87-4477-ada2-90101cae3472 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:34.988297 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-e60aecf6-ae87-4477-ada2-90101cae3472 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:35.115676 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-e60aecf6-ae87-4477-ada2-90101cae3472 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:35.123311 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-e60aecf6-ae87-4477-ada2-90101cae3472 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab" status: 200 len: 1368 microversion: 2.1 time: 0.147967 Sep 20 04:52:35.123879 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 48/111] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:34 2022] GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:35.758600 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-a56030d5-0f37-4976-b30c-bcbf4fa81cd4 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:35.759216 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-a56030d5-0f37-4976-b30c-bcbf4fa81cd4 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] [instance: 033b2f0d-760f-467a-9b3b-e7a8f2196aa7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:35.765238 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a56030d5-0f37-4976-b30c-bcbf4fa81cd4 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:35.765716 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a56030d5-0f37-4976-b30c-bcbf4fa81cd4 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:35.766149 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a56030d5-0f37-4976-b30c-bcbf4fa81cd4 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:35.766829 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a56030d5-0f37-4976-b30c-bcbf4fa81cd4 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:35.767281 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a56030d5-0f37-4976-b30c-bcbf4fa81cd4 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:35.767706 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a56030d5-0f37-4976-b30c-bcbf4fa81cd4 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:35.781193 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-77e4aee3-48da-4da4-95ce-97115d599f3f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:35.781795 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-77e4aee3-48da-4da4-95ce-97115d599f3f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:35.788509 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-77e4aee3-48da-4da4-95ce-97115d599f3f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:35.789678 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-77e4aee3-48da-4da4-95ce-97115d599f3f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:35.790824 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-77e4aee3-48da-4da4-95ce-97115d599f3f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:35.791684 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-77e4aee3-48da-4da4-95ce-97115d599f3f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:35.792742 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-77e4aee3-48da-4da4-95ce-97115d599f3f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:35.793668 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-77e4aee3-48da-4da4-95ce-97115d599f3f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:35.958332 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-a56030d5-0f37-4976-b30c-bcbf4fa81cd4 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77211762af4cc9b4f0a2f74ac3ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa7ea3cb69454797bd7956e12f2a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:35.964637 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-77e4aee3-48da-4da4-95ce-97115d599f3f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:35.966018 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-a56030d5-0f37-4976-b30c-bcbf4fa81cd4 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] 10.222.0.27 "GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7" status: 200 len: 1314 microversion: 2.1 time: 0.211225 Sep 20 04:52:35.966588 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 64/112] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:35 2022] GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:35.972338 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-77e4aee3-48da-4da4-95ce-97115d599f3f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1322 microversion: 2.1 time: 0.194853 Sep 20 04:52:35.972925 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 49/113] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:35 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:52:36.146744 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-a80dd758-126a-4d8d-afa4-0557ce55e5ef tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:36.147348 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-a80dd758-126a-4d8d-afa4-0557ce55e5ef tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:36.156203 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a80dd758-126a-4d8d-afa4-0557ce55e5ef tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:36.156203 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a80dd758-126a-4d8d-afa4-0557ce55e5ef tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:36.156203 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a80dd758-126a-4d8d-afa4-0557ce55e5ef tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:36.156203 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a80dd758-126a-4d8d-afa4-0557ce55e5ef tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:36.156539 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a80dd758-126a-4d8d-afa4-0557ce55e5ef tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:36.156819 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a80dd758-126a-4d8d-afa4-0557ce55e5ef tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:36.285366 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-a80dd758-126a-4d8d-afa4-0557ce55e5ef tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:36.293022 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-a80dd758-126a-4d8d-afa4-0557ce55e5ef tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab" status: 200 len: 1368 microversion: 2.1 time: 0.150332 Sep 20 04:52:36.293594 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 65/114] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:36 2022] GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:36.989900 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-5ac34967-645e-4aaf-8a5a-b1140ed27a94 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:36.989900 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-5ac34967-645e-4aaf-8a5a-b1140ed27a94 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] [instance: 033b2f0d-760f-467a-9b3b-e7a8f2196aa7] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:36.995674 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-5ac34967-645e-4aaf-8a5a-b1140ed27a94 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:36.995963 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-c55fd18d-7518-4deb-a45a-c8fed29e5943 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:36.996902 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-c55fd18d-7518-4deb-a45a-c8fed29e5943 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:36.997337 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-5ac34967-645e-4aaf-8a5a-b1140ed27a94 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:36.998027 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-5ac34967-645e-4aaf-8a5a-b1140ed27a94 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:36.999394 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-5ac34967-645e-4aaf-8a5a-b1140ed27a94 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:36.999872 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-5ac34967-645e-4aaf-8a5a-b1140ed27a94 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:37.000303 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-5ac34967-645e-4aaf-8a5a-b1140ed27a94 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:37.003568 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c55fd18d-7518-4deb-a45a-c8fed29e5943 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:37.004023 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c55fd18d-7518-4deb-a45a-c8fed29e5943 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:37.004459 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c55fd18d-7518-4deb-a45a-c8fed29e5943 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:37.005258 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c55fd18d-7518-4deb-a45a-c8fed29e5943 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:37.005650 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c55fd18d-7518-4deb-a45a-c8fed29e5943 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:37.006074 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c55fd18d-7518-4deb-a45a-c8fed29e5943 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:37.202352 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-5ac34967-645e-4aaf-8a5a-b1140ed27a94 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77211762af4cc9b4f0a2f74ac3ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa7ea3cb69454797bd7956e12f2a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:37.210945 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-5ac34967-645e-4aaf-8a5a-b1140ed27a94 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] 10.222.0.27 "GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7" status: 200 len: 1314 microversion: 2.1 time: 0.226603 Sep 20 04:52:37.211642 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 50/115] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:36 2022] GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:37.216178 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-c55fd18d-7518-4deb-a45a-c8fed29e5943 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:37.225157 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-c55fd18d-7518-4deb-a45a-c8fed29e5943 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1322 microversion: 2.1 time: 0.233316 Sep 20 04:52:37.226206 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 66/116] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:36 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:37.316279 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-c961b096-9731-4625-a538-53acbc087a7f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:37.316924 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-c961b096-9731-4625-a538-53acbc087a7f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:37.323184 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-c961b096-9731-4625-a538-53acbc087a7f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:37.323701 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-c961b096-9731-4625-a538-53acbc087a7f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:37.324138 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-c961b096-9731-4625-a538-53acbc087a7f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:37.324859 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-c961b096-9731-4625-a538-53acbc087a7f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:37.325305 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-c961b096-9731-4625-a538-53acbc087a7f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:37.325726 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-c961b096-9731-4625-a538-53acbc087a7f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:37.498946 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-c961b096-9731-4625-a538-53acbc087a7f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:37.507438 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-c961b096-9731-4625-a538-53acbc087a7f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab" status: 200 len: 1368 microversion: 2.1 time: 0.194941 Sep 20 04:52:37.508046 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 51/117] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:37 2022] GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab => generated 1368 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:38.234981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-7a8acfa7-786e-4447-a83d-f63c307971cd tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:38.236432 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-7a8acfa7-786e-4447-a83d-f63c307971cd tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] [instance: 033b2f0d-760f-467a-9b3b-e7a8f2196aa7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:38.249221 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-cbf4f3ee-cbf0-474f-9a54-ca2aa71ab7cf tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:38.252323 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-cbf4f3ee-cbf0-474f-9a54-ca2aa71ab7cf tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:38.254042 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7a8acfa7-786e-4447-a83d-f63c307971cd tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:38.254592 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7a8acfa7-786e-4447-a83d-f63c307971cd tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:38.255032 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7a8acfa7-786e-4447-a83d-f63c307971cd tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:38.255762 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7a8acfa7-786e-4447-a83d-f63c307971cd tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:38.256208 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7a8acfa7-786e-4447-a83d-f63c307971cd tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:38.256652 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7a8acfa7-786e-4447-a83d-f63c307971cd tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:38.260735 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-cbf4f3ee-cbf0-474f-9a54-ca2aa71ab7cf tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:38.264802 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-cbf4f3ee-cbf0-474f-9a54-ca2aa71ab7cf tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:38.265466 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-cbf4f3ee-cbf0-474f-9a54-ca2aa71ab7cf tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:38.266517 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-cbf4f3ee-cbf0-474f-9a54-ca2aa71ab7cf tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:38.267127 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-cbf4f3ee-cbf0-474f-9a54-ca2aa71ab7cf tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:38.267699 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-cbf4f3ee-cbf0-474f-9a54-ca2aa71ab7cf tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:38.630660 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-7a8acfa7-786e-4447-a83d-f63c307971cd tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77211762af4cc9b4f0a2f74ac3ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa7ea3cb69454797bd7956e12f2a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:38.637823 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-cbf4f3ee-cbf0-474f-9a54-ca2aa71ab7cf tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:38.638756 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-7a8acfa7-786e-4447-a83d-f63c307971cd tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] 10.222.0.27 "GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7" status: 200 len: 1314 microversion: 2.1 time: 0.408349 Sep 20 04:52:38.639328 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 67/118] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:38 2022] GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7 => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:38.644510 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-88d824e7-25cf-4359-bc36-71ead0418583 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:38.645143 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-88d824e7-25cf-4359-bc36-71ead0418583 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:38.646465 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-cbf4f3ee-cbf0-474f-9a54-ca2aa71ab7cf tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1322 microversion: 2.1 time: 0.402386 Sep 20 04:52:38.649104 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 52/119] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:38 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1322 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:52:38.656761 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-88d824e7-25cf-4359-bc36-71ead0418583 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:38.656761 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-88d824e7-25cf-4359-bc36-71ead0418583 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:38.656761 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-88d824e7-25cf-4359-bc36-71ead0418583 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:38.656761 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-88d824e7-25cf-4359-bc36-71ead0418583 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:38.657111 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-88d824e7-25cf-4359-bc36-71ead0418583 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:38.657111 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-88d824e7-25cf-4359-bc36-71ead0418583 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:38.800884 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-88d824e7-25cf-4359-bc36-71ead0418583 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:38.812459 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-88d824e7-25cf-4359-bc36-71ead0418583 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab" status: 200 len: 1368 microversion: 2.1 time: 0.171092 Sep 20 04:52:38.813404 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 68/120] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:38 2022] GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:38.929527 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [req-28f572ce-9cde-4b6f-bb90-5da2f069f45c req-febfa4d6-4b20-456b-a859-19df47f30246 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4e85593-565d-40c6-bed2-121ca9466654", "name": "network-vif-plugged", "status": "completed", "tag": "512e1b53-d964-4c70-8001-91bd16999e8b"}]} {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:52:38.941100 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [req-28f572ce-9cde-4b6f-bb90-5da2f069f45c req-febfa4d6-4b20-456b-a859-19df47f30246 service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:38.941784 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [req-28f572ce-9cde-4b6f-bb90-5da2f069f45c req-febfa4d6-4b20-456b-a859-19df47f30246 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:38.942191 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [req-28f572ce-9cde-4b6f-bb90-5da2f069f45c req-febfa4d6-4b20-456b-a859-19df47f30246 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:38.958131 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.compute.server_external_events [req-28f572ce-9cde-4b6f-bb90-5da2f069f45c req-febfa4d6-4b20-456b-a859-19df47f30246 service nova] Creating event network-vif-plugged:512e1b53-d964-4c70-8001-91bd16999e8b for instance d4e85593-565d-40c6-bed2-121ca9466654 on hv-cinder-75671 Sep 20 04:52:38.963533 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [req-28f572ce-9cde-4b6f-bb90-5da2f069f45c req-febfa4d6-4b20-456b-a859-19df47f30246 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038022 Sep 20 04:52:38.964447 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 53/121] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 04:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 04:52:39.670273 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-e6b3bb79-7a07-449d-ac47-42d91ff8c56b tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:39.670273 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-e6b3bb79-7a07-449d-ac47-42d91ff8c56b tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] [instance: 033b2f0d-760f-467a-9b3b-e7a8f2196aa7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:39.675909 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-ee6cdf7b-dc67-4ed0-9499-260c14bce38d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:39.676796 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-ee6cdf7b-dc67-4ed0-9499-260c14bce38d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:39.680595 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e6b3bb79-7a07-449d-ac47-42d91ff8c56b tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:39.682973 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e6b3bb79-7a07-449d-ac47-42d91ff8c56b tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:39.683522 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e6b3bb79-7a07-449d-ac47-42d91ff8c56b tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:39.686010 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-ee6cdf7b-dc67-4ed0-9499-260c14bce38d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:39.686578 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e6b3bb79-7a07-449d-ac47-42d91ff8c56b tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:39.687062 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e6b3bb79-7a07-449d-ac47-42d91ff8c56b tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:39.687472 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e6b3bb79-7a07-449d-ac47-42d91ff8c56b tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:39.692115 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-ee6cdf7b-dc67-4ed0-9499-260c14bce38d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:39.692764 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-ee6cdf7b-dc67-4ed0-9499-260c14bce38d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:39.693643 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-ee6cdf7b-dc67-4ed0-9499-260c14bce38d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:39.694271 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-ee6cdf7b-dc67-4ed0-9499-260c14bce38d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:39.694695 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-ee6cdf7b-dc67-4ed0-9499-260c14bce38d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:39.923127 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-e6b3bb79-7a07-449d-ac47-42d91ff8c56b tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77211762af4cc9b4f0a2f74ac3ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa7ea3cb69454797bd7956e12f2a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:39.931674 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-ee6cdf7b-dc67-4ed0-9499-260c14bce38d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:39.937445 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-e6b3bb79-7a07-449d-ac47-42d91ff8c56b tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] 10.222.0.27 "GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7" status: 200 len: 1502 microversion: 2.1 time: 0.278697 Sep 20 04:52:39.938029 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 69/122] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:39 2022] GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7 => generated 1502 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:39.941222 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-ee6cdf7b-dc67-4ed0-9499-260c14bce38d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1322 microversion: 2.1 time: 0.269539 Sep 20 04:52:39.941788 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 54/123] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:39 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1322 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:39.966685 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-dbc6a3fa-264b-4321-9d24-200d03792c2e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:39.967926 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-dbc6a3fa-264b-4321-9d24-200d03792c2e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:39.977724 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-dbc6a3fa-264b-4321-9d24-200d03792c2e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:39.978585 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-dbc6a3fa-264b-4321-9d24-200d03792c2e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:39.979598 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-dbc6a3fa-264b-4321-9d24-200d03792c2e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:39.980815 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-dbc6a3fa-264b-4321-9d24-200d03792c2e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:39.981771 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-dbc6a3fa-264b-4321-9d24-200d03792c2e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:39.982409 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-dbc6a3fa-264b-4321-9d24-200d03792c2e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:40.153821 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-dbc6a3fa-264b-4321-9d24-200d03792c2e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:40.160719 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell1:SELECT=100 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:40.164398 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-dbc6a3fa-264b-4321-9d24-200d03792c2e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab" status: 200 len: 1368 microversion: 2.1 time: 0.209212 Sep 20 04:52:40.165483 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 70/124] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:39 2022] GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab => generated 1368 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:40.966099 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-95ee9b83-8faa-4ab2-a064-537200eb28e4 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:40.966723 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-95ee9b83-8faa-4ab2-a064-537200eb28e4 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:40.973373 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-95ee9b83-8faa-4ab2-a064-537200eb28e4 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:40.973939 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-95ee9b83-8faa-4ab2-a064-537200eb28e4 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:40.974644 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-95ee9b83-8faa-4ab2-a064-537200eb28e4 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:40.975417 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-95ee9b83-8faa-4ab2-a064-537200eb28e4 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:40.975874 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-95ee9b83-8faa-4ab2-a064-537200eb28e4 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:40.976883 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-95ee9b83-8faa-4ab2-a064-537200eb28e4 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:41.134780 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-95ee9b83-8faa-4ab2-a064-537200eb28e4 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:41.143146 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-95ee9b83-8faa-4ab2-a064-537200eb28e4 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1322 microversion: 2.1 time: 0.180900 Sep 20 04:52:41.143688 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 55/125] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:40 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:41.189284 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-d605a87a-8fc4-41c1-b4fa-c654a0c2f126 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:41.189929 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-d605a87a-8fc4-41c1-b4fa-c654a0c2f126 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:41.196232 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d605a87a-8fc4-41c1-b4fa-c654a0c2f126 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:41.196744 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d605a87a-8fc4-41c1-b4fa-c654a0c2f126 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:41.197175 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d605a87a-8fc4-41c1-b4fa-c654a0c2f126 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:41.197859 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d605a87a-8fc4-41c1-b4fa-c654a0c2f126 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:41.198303 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d605a87a-8fc4-41c1-b4fa-c654a0c2f126 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:41.198724 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d605a87a-8fc4-41c1-b4fa-c654a0c2f126 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:41.343293 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-d605a87a-8fc4-41c1-b4fa-c654a0c2f126 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:41.351326 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-d605a87a-8fc4-41c1-b4fa-c654a0c2f126 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab" status: 200 len: 1368 microversion: 2.1 time: 0.167385 Sep 20 04:52:41.351902 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 71/126] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:41 2022] GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:42.166393 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-042fc09e-0943-46c0-8582-db8ab2e1350b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:42.167241 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-042fc09e-0943-46c0-8582-db8ab2e1350b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:42.173338 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-042fc09e-0943-46c0-8582-db8ab2e1350b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:42.173890 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-042fc09e-0943-46c0-8582-db8ab2e1350b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:42.174398 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-042fc09e-0943-46c0-8582-db8ab2e1350b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:42.175186 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-042fc09e-0943-46c0-8582-db8ab2e1350b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:42.175639 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-042fc09e-0943-46c0-8582-db8ab2e1350b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:42.176069 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-042fc09e-0943-46c0-8582-db8ab2e1350b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:42.319580 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-042fc09e-0943-46c0-8582-db8ab2e1350b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:42.331073 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-042fc09e-0943-46c0-8582-db8ab2e1350b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1322 microversion: 2.1 time: 0.168729 Sep 20 04:52:42.332640 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 56/127] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:42 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:42.378629 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-f1bdcd60-6b8c-4926-8c42-20bba15fcc72 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:42.379790 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-f1bdcd60-6b8c-4926-8c42-20bba15fcc72 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:42.385976 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f1bdcd60-6b8c-4926-8c42-20bba15fcc72 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:42.386458 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f1bdcd60-6b8c-4926-8c42-20bba15fcc72 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:42.386885 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f1bdcd60-6b8c-4926-8c42-20bba15fcc72 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:42.387572 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f1bdcd60-6b8c-4926-8c42-20bba15fcc72 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:42.388013 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f1bdcd60-6b8c-4926-8c42-20bba15fcc72 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:42.388425 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f1bdcd60-6b8c-4926-8c42-20bba15fcc72 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:42.536916 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-f1bdcd60-6b8c-4926-8c42-20bba15fcc72 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:42.544576 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-f1bdcd60-6b8c-4926-8c42-20bba15fcc72 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab" status: 200 len: 1368 microversion: 2.1 time: 0.171138 Sep 20 04:52:42.545160 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 72/128] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:42 2022] GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:43.354312 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-f26d21b8-28ac-459e-b1a9-81ce5ab33e0a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:43.354947 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-f26d21b8-28ac-459e-b1a9-81ce5ab33e0a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:43.361566 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-f26d21b8-28ac-459e-b1a9-81ce5ab33e0a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:43.362046 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-f26d21b8-28ac-459e-b1a9-81ce5ab33e0a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:43.362476 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-f26d21b8-28ac-459e-b1a9-81ce5ab33e0a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:43.363367 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-f26d21b8-28ac-459e-b1a9-81ce5ab33e0a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:43.363925 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-f26d21b8-28ac-459e-b1a9-81ce5ab33e0a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:43.364387 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-f26d21b8-28ac-459e-b1a9-81ce5ab33e0a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:43.527847 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-f26d21b8-28ac-459e-b1a9-81ce5ab33e0a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:43.537958 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-f26d21b8-28ac-459e-b1a9-81ce5ab33e0a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1322 microversion: 2.1 time: 0.187428 Sep 20 04:52:43.539050 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 57/129] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:43 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:43.578652 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-a178fff4-9983-4a9e-b2f7-e37cd246c561 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:43.582925 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-a178fff4-9983-4a9e-b2f7-e37cd246c561 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:43.591225 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a178fff4-9983-4a9e-b2f7-e37cd246c561 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:43.592411 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a178fff4-9983-4a9e-b2f7-e37cd246c561 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:43.593065 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a178fff4-9983-4a9e-b2f7-e37cd246c561 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:43.593944 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a178fff4-9983-4a9e-b2f7-e37cd246c561 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:43.594572 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a178fff4-9983-4a9e-b2f7-e37cd246c561 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:43.595288 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a178fff4-9983-4a9e-b2f7-e37cd246c561 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:43.757624 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-42998e01-f97b-49b4-aae3-d290591d45e8 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc0d90ed-86b2-435f-acf8-4fc0900bc4ec"}} {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:52:43.760282 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-42998e01-f97b-49b4-aae3-d290591d45e8 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] [instance: 033b2f0d-760f-467a-9b3b-e7a8f2196aa7] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:43.777571 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-42998e01-f97b-49b4-aae3-d290591d45e8 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:43.778930 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-42998e01-f97b-49b4-aae3-d290591d45e8 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:43.780652 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-42998e01-f97b-49b4-aae3-d290591d45e8 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:43.781739 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-42998e01-f97b-49b4-aae3-d290591d45e8 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:43.782289 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-42998e01-f97b-49b4-aae3-d290591d45e8 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:43.783859 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-42998e01-f97b-49b4-aae3-d290591d45e8 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:43.800975 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-a178fff4-9983-4a9e-b2f7-e37cd246c561 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:43.820261 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-a178fff4-9983-4a9e-b2f7-e37cd246c561 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab" status: 200 len: 1368 microversion: 2.1 time: 0.248362 Sep 20 04:52:43.822716 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 73/130] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:43 2022] GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab => generated 1368 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:44.562763 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-7b95482e-88db-415f-adc0-4e6eeaa68b95 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:44.563372 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-7b95482e-88db-415f-adc0-4e6eeaa68b95 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:44.569301 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7b95482e-88db-415f-adc0-4e6eeaa68b95 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:44.569829 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7b95482e-88db-415f-adc0-4e6eeaa68b95 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:44.570443 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7b95482e-88db-415f-adc0-4e6eeaa68b95 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:44.571123 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7b95482e-88db-415f-adc0-4e6eeaa68b95 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:44.571575 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7b95482e-88db-415f-adc0-4e6eeaa68b95 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:44.571993 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7b95482e-88db-415f-adc0-4e6eeaa68b95 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:44.695776 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-7b95482e-88db-415f-adc0-4e6eeaa68b95 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:44.703399 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-7b95482e-88db-415f-adc0-4e6eeaa68b95 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1322 microversion: 2.1 time: 0.144364 Sep 20 04:52:44.703899 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 74/131] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:44 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1322 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:52:44.862804 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-769e96d2-2f93-4da0-8a4e-e90f1b2c93b6 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:44.863410 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-769e96d2-2f93-4da0-8a4e-e90f1b2c93b6 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:44.869551 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-769e96d2-2f93-4da0-8a4e-e90f1b2c93b6 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:44.870205 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-769e96d2-2f93-4da0-8a4e-e90f1b2c93b6 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:44.870476 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-769e96d2-2f93-4da0-8a4e-e90f1b2c93b6 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:44.871146 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-769e96d2-2f93-4da0-8a4e-e90f1b2c93b6 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:44.871588 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-769e96d2-2f93-4da0-8a4e-e90f1b2c93b6 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:44.872004 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-769e96d2-2f93-4da0-8a4e-e90f1b2c93b6 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:45.009996 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-769e96d2-2f93-4da0-8a4e-e90f1b2c93b6 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:45.017541 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-769e96d2-2f93-4da0-8a4e-e90f1b2c93b6 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab" status: 200 len: 1368 microversion: 2.1 time: 0.158510 Sep 20 04:52:45.018095 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 75/132] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:44 2022] GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:45.726468 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-eeeef394-42a7-4c51-b369-d437b2fbcc6a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:45.727097 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-eeeef394-42a7-4c51-b369-d437b2fbcc6a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:45.732985 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-eeeef394-42a7-4c51-b369-d437b2fbcc6a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:45.733459 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-eeeef394-42a7-4c51-b369-d437b2fbcc6a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:45.733887 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-eeeef394-42a7-4c51-b369-d437b2fbcc6a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:45.734571 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-eeeef394-42a7-4c51-b369-d437b2fbcc6a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:45.735019 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-eeeef394-42a7-4c51-b369-d437b2fbcc6a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:45.735434 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-eeeef394-42a7-4c51-b369-d437b2fbcc6a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:45.861311 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-eeeef394-42a7-4c51-b369-d437b2fbcc6a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:45.868878 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-eeeef394-42a7-4c51-b369-d437b2fbcc6a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1322 microversion: 2.1 time: 0.146658 Sep 20 04:52:45.869437 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 76/133] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:45 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:52:46.041478 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-8b7792d1-811f-418a-bf49-a0f9d376c2a0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:46.042151 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-8b7792d1-811f-418a-bf49-a0f9d376c2a0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:46.047971 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8b7792d1-811f-418a-bf49-a0f9d376c2a0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:46.048440 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8b7792d1-811f-418a-bf49-a0f9d376c2a0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:46.048895 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8b7792d1-811f-418a-bf49-a0f9d376c2a0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:46.049571 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8b7792d1-811f-418a-bf49-a0f9d376c2a0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:46.050012 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8b7792d1-811f-418a-bf49-a0f9d376c2a0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:46.050424 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8b7792d1-811f-418a-bf49-a0f9d376c2a0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:46.178053 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-8b7792d1-811f-418a-bf49-a0f9d376c2a0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:46.185642 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-8b7792d1-811f-418a-bf49-a0f9d376c2a0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab" status: 200 len: 1368 microversion: 2.1 time: 0.148551 Sep 20 04:52:46.186196 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 77/134] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:46 2022] GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:52:46.890806 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-15379920-5260-4eb6-896f-9e174bd4fd8f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:46.891467 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-15379920-5260-4eb6-896f-9e174bd4fd8f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:46.893403 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:46.899359 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-15379920-5260-4eb6-896f-9e174bd4fd8f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:46.899850 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-15379920-5260-4eb6-896f-9e174bd4fd8f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:46.900281 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-15379920-5260-4eb6-896f-9e174bd4fd8f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:46.901016 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-15379920-5260-4eb6-896f-9e174bd4fd8f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:46.901464 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-15379920-5260-4eb6-896f-9e174bd4fd8f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:46.901887 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-15379920-5260-4eb6-896f-9e174bd4fd8f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:46.946617 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-42998e01-f97b-49b4-aae3-d290591d45e8 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] 10.222.0.27 "POST /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.192847 Sep 20 04:52:46.947594 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 58/135] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Sep 20 04:52:43 2022] POST /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7/os-volume_attachments => generated 194 bytes in 3195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 04:52:47.062336 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-15379920-5260-4eb6-896f-9e174bd4fd8f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:47.070655 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-15379920-5260-4eb6-896f-9e174bd4fd8f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1322 microversion: 2.1 time: 0.183714 Sep 20 04:52:47.071305 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 78/136] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:46 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:52:47.209435 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-9c205304-e059-4826-98ad-e84a7dae4019 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:47.210121 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-9c205304-e059-4826-98ad-e84a7dae4019 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:47.212048 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG dbcounter [-] [126814] Writing DB stats nova_api:SELECT=66 {{(pid=126814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:47.218844 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-9c205304-e059-4826-98ad-e84a7dae4019 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:47.219344 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-9c205304-e059-4826-98ad-e84a7dae4019 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:47.219774 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-9c205304-e059-4826-98ad-e84a7dae4019 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:47.220592 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-9c205304-e059-4826-98ad-e84a7dae4019 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:47.221105 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-9c205304-e059-4826-98ad-e84a7dae4019 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:47.221535 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-9c205304-e059-4826-98ad-e84a7dae4019 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:47.236768 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG dbcounter [-] [126814] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:47.374963 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-9c205304-e059-4826-98ad-e84a7dae4019 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:47.395428 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-9c205304-e059-4826-98ad-e84a7dae4019 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab" status: 200 len: 1368 microversion: 2.1 time: 0.190373 Sep 20 04:52:47.396128 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 59/137] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:47 2022] GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab => generated 1368 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:48.093728 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-0fcbc644-ae04-457c-aab5-f4c12283a14d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:48.094464 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-0fcbc644-ae04-457c-aab5-f4c12283a14d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:48.102663 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0fcbc644-ae04-457c-aab5-f4c12283a14d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:48.103315 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0fcbc644-ae04-457c-aab5-f4c12283a14d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:48.103972 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0fcbc644-ae04-457c-aab5-f4c12283a14d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:48.105770 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0fcbc644-ae04-457c-aab5-f4c12283a14d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:48.106442 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0fcbc644-ae04-457c-aab5-f4c12283a14d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:48.108135 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0fcbc644-ae04-457c-aab5-f4c12283a14d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:48.278419 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-0fcbc644-ae04-457c-aab5-f4c12283a14d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:48.294999 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-0fcbc644-ae04-457c-aab5-f4c12283a14d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1322 microversion: 2.1 time: 0.205009 Sep 20 04:52:48.295895 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 79/138] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:48 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:48.424479 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-11830638-dd3d-44ab-b490-7273988c335e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:48.427505 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-11830638-dd3d-44ab-b490-7273988c335e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:48.437365 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-11830638-dd3d-44ab-b490-7273988c335e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:48.438345 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-11830638-dd3d-44ab-b490-7273988c335e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:48.438824 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-11830638-dd3d-44ab-b490-7273988c335e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:48.439851 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-11830638-dd3d-44ab-b490-7273988c335e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:48.440261 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-11830638-dd3d-44ab-b490-7273988c335e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:48.440912 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-11830638-dd3d-44ab-b490-7273988c335e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:48.648300 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-11830638-dd3d-44ab-b490-7273988c335e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:48.656196 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-11830638-dd3d-44ab-b490-7273988c335e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab" status: 200 len: 1368 microversion: 2.1 time: 0.239174 Sep 20 04:52:48.669301 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 60/139] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:48 2022] GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab => generated 1368 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:49.318839 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-aa8614b3-305f-4284-b137-f5ba311b82d0 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:49.319504 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-aa8614b3-305f-4284-b137-f5ba311b82d0 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:49.325795 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-aa8614b3-305f-4284-b137-f5ba311b82d0 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:49.326249 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-aa8614b3-305f-4284-b137-f5ba311b82d0 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:49.326701 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-aa8614b3-305f-4284-b137-f5ba311b82d0 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:49.327389 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-aa8614b3-305f-4284-b137-f5ba311b82d0 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:49.327867 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-aa8614b3-305f-4284-b137-f5ba311b82d0 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:49.328287 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-aa8614b3-305f-4284-b137-f5ba311b82d0 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:49.459957 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-aa8614b3-305f-4284-b137-f5ba311b82d0 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:49.467752 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-aa8614b3-305f-4284-b137-f5ba311b82d0 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1516 microversion: 2.1 time: 0.152874 Sep 20 04:52:49.468312 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 80/140] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:49 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:49.491015 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-7aaaac34-35aa-4d14-8f29-1f492c13aad9 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:52:49.494707 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-7aaaac34-35aa-4d14-8f29-1f492c13aad9 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:49.501732 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-7aaaac34-35aa-4d14-8f29-1f492c13aad9 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:49.502565 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-7aaaac34-35aa-4d14-8f29-1f492c13aad9 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:49.503205 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-7aaaac34-35aa-4d14-8f29-1f492c13aad9 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:49.503897 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-7aaaac34-35aa-4d14-8f29-1f492c13aad9 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:49.504391 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-7aaaac34-35aa-4d14-8f29-1f492c13aad9 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:49.504955 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-7aaaac34-35aa-4d14-8f29-1f492c13aad9 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:49.531615 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.objects.instance [None req-7aaaac34-35aa-4d14-8f29-1f492c13aad9 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lazy-loading 'flavor' on Instance uuid d4e85593-565d-40c6-bed2-121ca9466654 {{(pid=126814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 04:52:49.651747 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-7aaaac34-35aa-4d14-8f29-1f492c13aad9 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "POST /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654/action" status: 200 len: 32 microversion: 2.1 time: 0.164796 Sep 20 04:52:49.652394 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 61/141] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Sep 20 04:52:49 2022] POST /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654/action => generated 32 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 20 04:52:49.662040 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-8cf41fef-a215-4307-9798-e869c34637b7 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:49.664341 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-8cf41fef-a215-4307-9798-e869c34637b7 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:49.671016 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8cf41fef-a215-4307-9798-e869c34637b7 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:49.671484 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8cf41fef-a215-4307-9798-e869c34637b7 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:49.672097 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8cf41fef-a215-4307-9798-e869c34637b7 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:49.672935 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8cf41fef-a215-4307-9798-e869c34637b7 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:49.673516 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8cf41fef-a215-4307-9798-e869c34637b7 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:49.674233 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8cf41fef-a215-4307-9798-e869c34637b7 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:49.683460 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-fcce3142-6afb-41ac-b493-66008ed8b450 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:49.684157 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-fcce3142-6afb-41ac-b493-66008ed8b450 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:49.691216 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-fcce3142-6afb-41ac-b493-66008ed8b450 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:49.691734 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-fcce3142-6afb-41ac-b493-66008ed8b450 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:49.692121 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-fcce3142-6afb-41ac-b493-66008ed8b450 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:49.692837 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-fcce3142-6afb-41ac-b493-66008ed8b450 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:49.693286 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-fcce3142-6afb-41ac-b493-66008ed8b450 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:49.693709 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-fcce3142-6afb-41ac-b493-66008ed8b450 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:49.882839 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-8cf41fef-a215-4307-9798-e869c34637b7 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:49.889359 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-fcce3142-6afb-41ac-b493-66008ed8b450 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:49.890866 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-8cf41fef-a215-4307-9798-e869c34637b7 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1522 microversion: 2.1 time: 0.232931 Sep 20 04:52:49.891441 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 81/142] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:49 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:49.904794 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-fcce3142-6afb-41ac-b493-66008ed8b450 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab" status: 200 len: 1368 microversion: 2.1 time: 0.219795 Sep 20 04:52:49.904794 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 62/143] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:49 2022] GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab => generated 1368 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:50.915521 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-c06ef482-1c0c-4916-9b36-0fbe06923d1a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:50.916131 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-c06ef482-1c0c-4916-9b36-0fbe06923d1a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:50.922392 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-3b8165cf-9879-493d-b03b-8a3f0d19c80b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:50.923097 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-3b8165cf-9879-493d-b03b-8a3f0d19c80b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:50.930047 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3b8165cf-9879-493d-b03b-8a3f0d19c80b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:50.930536 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3b8165cf-9879-493d-b03b-8a3f0d19c80b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:50.930972 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3b8165cf-9879-493d-b03b-8a3f0d19c80b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:50.931696 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3b8165cf-9879-493d-b03b-8a3f0d19c80b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:50.932142 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3b8165cf-9879-493d-b03b-8a3f0d19c80b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:50.932243 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-c06ef482-1c0c-4916-9b36-0fbe06923d1a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:50.932703 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-c06ef482-1c0c-4916-9b36-0fbe06923d1a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:50.932819 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3b8165cf-9879-493d-b03b-8a3f0d19c80b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:50.933139 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-c06ef482-1c0c-4916-9b36-0fbe06923d1a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:50.939740 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-c06ef482-1c0c-4916-9b36-0fbe06923d1a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:50.940218 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-c06ef482-1c0c-4916-9b36-0fbe06923d1a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:50.940680 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-c06ef482-1c0c-4916-9b36-0fbe06923d1a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:51.148621 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-c06ef482-1c0c-4916-9b36-0fbe06923d1a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:51.152015 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-3b8165cf-9879-493d-b03b-8a3f0d19c80b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:51.165495 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-c06ef482-1c0c-4916-9b36-0fbe06923d1a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1522 microversion: 2.1 time: 0.254377 Sep 20 04:52:51.166789 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 63/144] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:50 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:51.182967 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-3b8165cf-9879-493d-b03b-8a3f0d19c80b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab" status: 200 len: 1368 microversion: 2.1 time: 0.264511 Sep 20 04:52:51.183720 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 82/145] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:50 2022] GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab => generated 1368 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:52:52.191457 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-7daf682d-8745-49c9-b8f9-2478c6f19fb2 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:52.192077 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-7daf682d-8745-49c9-b8f9-2478c6f19fb2 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:52.206569 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-20e61470-0bce-4a61-a279-0fb775e23231 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:52.207036 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-20e61470-0bce-4a61-a279-0fb775e23231 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:52.214228 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-20e61470-0bce-4a61-a279-0fb775e23231 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:52.214491 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-7daf682d-8745-49c9-b8f9-2478c6f19fb2 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:52.214726 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-7daf682d-8745-49c9-b8f9-2478c6f19fb2 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:52.214841 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-20e61470-0bce-4a61-a279-0fb775e23231 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:52.215154 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-20e61470-0bce-4a61-a279-0fb775e23231 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:52.215285 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-7daf682d-8745-49c9-b8f9-2478c6f19fb2 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:52.215869 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-7daf682d-8745-49c9-b8f9-2478c6f19fb2 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:52.215996 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-20e61470-0bce-4a61-a279-0fb775e23231 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:52.216319 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-7daf682d-8745-49c9-b8f9-2478c6f19fb2 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:52.216431 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-20e61470-0bce-4a61-a279-0fb775e23231 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:52.216783 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-7daf682d-8745-49c9-b8f9-2478c6f19fb2 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:52.216887 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-20e61470-0bce-4a61-a279-0fb775e23231 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:52.573088 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-20e61470-0bce-4a61-a279-0fb775e23231 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:52.584020 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-20e61470-0bce-4a61-a279-0fb775e23231 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab" status: 200 len: 1368 microversion: 2.1 time: 0.381377 Sep 20 04:52:52.589906 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-7daf682d-8745-49c9-b8f9-2478c6f19fb2 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:52.602068 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 83/146] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:52 2022] GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab => generated 1368 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:52:52.604044 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-7daf682d-8745-49c9-b8f9-2478c6f19fb2 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1522 microversion: 2.1 time: 0.416453 Sep 20 04:52:52.605121 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 64/147] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:52 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1522 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:53.631863 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-3bb1f5c8-c4c5-45f4-96f1-cb15c458b387 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:53.633818 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-677eefba-c302-4418-a028-76d5f41bbbd1 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:53.634526 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-677eefba-c302-4418-a028-76d5f41bbbd1 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:53.638573 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-3bb1f5c8-c4c5-45f4-96f1-cb15c458b387 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:53.649411 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3bb1f5c8-c4c5-45f4-96f1-cb15c458b387 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:53.650910 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-677eefba-c302-4418-a028-76d5f41bbbd1 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:53.651437 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3bb1f5c8-c4c5-45f4-96f1-cb15c458b387 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:53.652050 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-677eefba-c302-4418-a028-76d5f41bbbd1 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:53.652642 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3bb1f5c8-c4c5-45f4-96f1-cb15c458b387 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:53.653268 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-677eefba-c302-4418-a028-76d5f41bbbd1 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:53.654151 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3bb1f5c8-c4c5-45f4-96f1-cb15c458b387 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:53.655221 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-677eefba-c302-4418-a028-76d5f41bbbd1 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:53.655355 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-677eefba-c302-4418-a028-76d5f41bbbd1 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:53.655811 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3bb1f5c8-c4c5-45f4-96f1-cb15c458b387 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:53.656297 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3bb1f5c8-c4c5-45f4-96f1-cb15c458b387 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:53.656947 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-677eefba-c302-4418-a028-76d5f41bbbd1 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:53.920497 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-3bb1f5c8-c4c5-45f4-96f1-cb15c458b387 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:53.934178 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-3bb1f5c8-c4c5-45f4-96f1-cb15c458b387 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab" status: 200 len: 1368 microversion: 2.1 time: 0.310665 Sep 20 04:52:53.934788 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 84/148] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:53 2022] GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab => generated 1368 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:53.940977 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-818ba5d3-3f0d-4396-a612-cc008bf254f1 req-7c11cf82-5114-475a-ada4-61fb4f6d5f82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7723784c-51e5-4936-b33a-caf9b1b87bab", "name": "network-vif-plugged", "status": "completed", "tag": "4e821eae-4814-40c5-b31f-2ea37b73d8f1"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:52:53.947544 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-677eefba-c302-4418-a028-76d5f41bbbd1 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:53.955602 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-677eefba-c302-4418-a028-76d5f41bbbd1 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1522 microversion: 2.1 time: 0.329851 Sep 20 04:52:53.956198 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 65/149] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:53 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1522 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:53.961870 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-818ba5d3-3f0d-4396-a612-cc008bf254f1 req-7c11cf82-5114-475a-ada4-61fb4f6d5f82 service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:53.962608 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-818ba5d3-3f0d-4396-a612-cc008bf254f1 req-7c11cf82-5114-475a-ada4-61fb4f6d5f82 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:53.963038 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-818ba5d3-3f0d-4396-a612-cc008bf254f1 req-7c11cf82-5114-475a-ada4-61fb4f6d5f82 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:53.976952 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-818ba5d3-3f0d-4396-a612-cc008bf254f1 req-7c11cf82-5114-475a-ada4-61fb4f6d5f82 service nova] Creating event network-vif-plugged:4e821eae-4814-40c5-b31f-2ea37b73d8f1 for instance 7723784c-51e5-4936-b33a-caf9b1b87bab on hv-cinder-75671 Sep 20 04:52:53.982570 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-818ba5d3-3f0d-4396-a612-cc008bf254f1 req-7c11cf82-5114-475a-ada4-61fb4f6d5f82 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046049 Sep 20 04:52:53.983378 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 85/150] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 04:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:52:54.958537 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-bb85eb94-9e7f-4e4c-bcfb-9c9d1f7cc4e2 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:54.959147 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-bb85eb94-9e7f-4e4c-bcfb-9c9d1f7cc4e2 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:54.966144 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-bb85eb94-9e7f-4e4c-bcfb-9c9d1f7cc4e2 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:54.966808 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-bb85eb94-9e7f-4e4c-bcfb-9c9d1f7cc4e2 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:54.967237 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-bb85eb94-9e7f-4e4c-bcfb-9c9d1f7cc4e2 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:54.968204 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-bb85eb94-9e7f-4e4c-bcfb-9c9d1f7cc4e2 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:54.968976 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-bb85eb94-9e7f-4e4c-bcfb-9c9d1f7cc4e2 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:54.969699 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-bb85eb94-9e7f-4e4c-bcfb-9c9d1f7cc4e2 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:54.980088 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-136abdb5-a751-4823-99ea-6dcc6f7d6215 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:54.981081 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-136abdb5-a751-4823-99ea-6dcc6f7d6215 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:54.990065 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-136abdb5-a751-4823-99ea-6dcc6f7d6215 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:54.990544 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-136abdb5-a751-4823-99ea-6dcc6f7d6215 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:54.990979 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-136abdb5-a751-4823-99ea-6dcc6f7d6215 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:54.992367 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-136abdb5-a751-4823-99ea-6dcc6f7d6215 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:54.992847 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-136abdb5-a751-4823-99ea-6dcc6f7d6215 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:54.993268 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-136abdb5-a751-4823-99ea-6dcc6f7d6215 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:55.214276 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-bb85eb94-9e7f-4e4c-bcfb-9c9d1f7cc4e2 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:55.219124 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-136abdb5-a751-4823-99ea-6dcc6f7d6215 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:55.236064 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-bb85eb94-9e7f-4e4c-bcfb-9c9d1f7cc4e2 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab" status: 200 len: 1368 microversion: 2.1 time: 0.281506 Sep 20 04:52:55.236693 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 66/151] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:54 2022] GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab => generated 1368 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:55.250142 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-136abdb5-a751-4823-99ea-6dcc6f7d6215 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1522 microversion: 2.1 time: 0.274553 Sep 20 04:52:55.261123 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 86/152] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:54 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:56.272827 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-62bb06d6-5b60-4096-a68f-51d7cfa2dea6 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:56.274179 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-62bb06d6-5b60-4096-a68f-51d7cfa2dea6 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:56.281523 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-62bb06d6-5b60-4096-a68f-51d7cfa2dea6 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:56.282030 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-62bb06d6-5b60-4096-a68f-51d7cfa2dea6 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:56.282461 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-62bb06d6-5b60-4096-a68f-51d7cfa2dea6 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:56.283178 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-62bb06d6-5b60-4096-a68f-51d7cfa2dea6 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:56.283624 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-62bb06d6-5b60-4096-a68f-51d7cfa2dea6 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:56.284039 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-62bb06d6-5b60-4096-a68f-51d7cfa2dea6 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:56.284575 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-0954613b-7af4-4bc9-8eda-9bc67d1b9938 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:56.287768 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-0954613b-7af4-4bc9-8eda-9bc67d1b9938 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:56.294625 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0954613b-7af4-4bc9-8eda-9bc67d1b9938 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:56.295161 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0954613b-7af4-4bc9-8eda-9bc67d1b9938 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:56.295596 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0954613b-7af4-4bc9-8eda-9bc67d1b9938 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:56.296316 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0954613b-7af4-4bc9-8eda-9bc67d1b9938 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:56.296792 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0954613b-7af4-4bc9-8eda-9bc67d1b9938 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:56.297658 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0954613b-7af4-4bc9-8eda-9bc67d1b9938 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:56.536208 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-62bb06d6-5b60-4096-a68f-51d7cfa2dea6 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:56.541025 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-0954613b-7af4-4bc9-8eda-9bc67d1b9938 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:56.547465 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-62bb06d6-5b60-4096-a68f-51d7cfa2dea6 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab" status: 200 len: 1368 microversion: 2.1 time: 0.277243 Sep 20 04:52:56.547465 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 67/153] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:56 2022] GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab => generated 1368 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:56.553310 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-0954613b-7af4-4bc9-8eda-9bc67d1b9938 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1522 microversion: 2.1 time: 0.272411 Sep 20 04:52:56.554073 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 87/154] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:56 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:57.572367 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-136129cf-59a3-45b2-a14a-cf7c87c781e0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:57.573798 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-136129cf-59a3-45b2-a14a-cf7c87c781e0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:57.577703 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-e5dd3945-2b98-45e8-b057-3cecd730a222 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:57.578862 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-e5dd3945-2b98-45e8-b057-3cecd730a222 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:57.579821 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-136129cf-59a3-45b2-a14a-cf7c87c781e0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:57.580319 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-136129cf-59a3-45b2-a14a-cf7c87c781e0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:57.581161 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-136129cf-59a3-45b2-a14a-cf7c87c781e0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:57.582028 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-136129cf-59a3-45b2-a14a-cf7c87c781e0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:57.582735 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-136129cf-59a3-45b2-a14a-cf7c87c781e0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:57.583768 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-136129cf-59a3-45b2-a14a-cf7c87c781e0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:57.587631 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e5dd3945-2b98-45e8-b057-3cecd730a222 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:57.588121 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e5dd3945-2b98-45e8-b057-3cecd730a222 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:57.588562 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e5dd3945-2b98-45e8-b057-3cecd730a222 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:57.591663 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e5dd3945-2b98-45e8-b057-3cecd730a222 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:57.592209 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e5dd3945-2b98-45e8-b057-3cecd730a222 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:57.592713 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e5dd3945-2b98-45e8-b057-3cecd730a222 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:57.599029 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell1:SELECT=100 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:57.805061 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-e5dd3945-2b98-45e8-b057-3cecd730a222 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:57.814183 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-e5dd3945-2b98-45e8-b057-3cecd730a222 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1522 microversion: 2.1 time: 0.240331 Sep 20 04:52:57.815195 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 88/155] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:57 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:57.818795 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-136129cf-59a3-45b2-a14a-cf7c87c781e0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:57.827981 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-136129cf-59a3-45b2-a14a-cf7c87c781e0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab" status: 200 len: 1368 microversion: 2.1 time: 0.260480 Sep 20 04:52:57.829364 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 68/156] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:57 2022] GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab => generated 1368 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:58.856244 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-c3e634cc-55ed-4dde-98a8-9962a2ed5919 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:58.856834 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-c3e634cc-55ed-4dde-98a8-9962a2ed5919 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:58.857283 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-98f9145f-d744-4a7f-89d3-9d3b143225f3 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:52:58.857893 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-98f9145f-d744-4a7f-89d3-9d3b143225f3 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:52:58.862969 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c3e634cc-55ed-4dde-98a8-9962a2ed5919 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:58.863441 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c3e634cc-55ed-4dde-98a8-9962a2ed5919 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:58.863868 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c3e634cc-55ed-4dde-98a8-9962a2ed5919 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:58.864253 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-98f9145f-d744-4a7f-89d3-9d3b143225f3 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:58.864540 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c3e634cc-55ed-4dde-98a8-9962a2ed5919 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:58.864769 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-98f9145f-d744-4a7f-89d3-9d3b143225f3 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:58.865007 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c3e634cc-55ed-4dde-98a8-9962a2ed5919 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:58.865204 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-98f9145f-d744-4a7f-89d3-9d3b143225f3 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:58.865426 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c3e634cc-55ed-4dde-98a8-9962a2ed5919 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:58.865893 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-98f9145f-d744-4a7f-89d3-9d3b143225f3 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:52:58.866339 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-98f9145f-d744-4a7f-89d3-9d3b143225f3 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:52:58.866761 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-98f9145f-d744-4a7f-89d3-9d3b143225f3 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:52:59.055985 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-c3e634cc-55ed-4dde-98a8-9962a2ed5919 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:59.064234 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-98f9145f-d744-4a7f-89d3-9d3b143225f3 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:52:59.067254 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-c3e634cc-55ed-4dde-98a8-9962a2ed5919 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1522 microversion: 2.1 time: 0.214455 Sep 20 04:52:59.067931 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 89/157] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:58 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:52:59.074419 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-98f9145f-d744-4a7f-89d3-9d3b143225f3 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab" status: 200 len: 1368 microversion: 2.1 time: 0.220786 Sep 20 04:52:59.075000 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 69/158] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:52:58 2022] GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab => generated 1368 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:53:00.091361 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-1be1e960-5646-4a41-8abe-9e9e6c5b486d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:00.092006 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-1be1e960-5646-4a41-8abe-9e9e6c5b486d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:00.098339 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1be1e960-5646-4a41-8abe-9e9e6c5b486d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:00.098497 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-58e96a5f-7f87-4293-9c84-7b074e1e8273 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:00.098882 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1be1e960-5646-4a41-8abe-9e9e6c5b486d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:00.099162 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-58e96a5f-7f87-4293-9c84-7b074e1e8273 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:00.099274 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1be1e960-5646-4a41-8abe-9e9e6c5b486d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:00.099925 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1be1e960-5646-4a41-8abe-9e9e6c5b486d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:00.101038 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1be1e960-5646-4a41-8abe-9e9e6c5b486d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:00.101474 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1be1e960-5646-4a41-8abe-9e9e6c5b486d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:00.106306 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-58e96a5f-7f87-4293-9c84-7b074e1e8273 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:00.106775 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-58e96a5f-7f87-4293-9c84-7b074e1e8273 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:00.107200 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-58e96a5f-7f87-4293-9c84-7b074e1e8273 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:00.107873 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-58e96a5f-7f87-4293-9c84-7b074e1e8273 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:00.108315 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-58e96a5f-7f87-4293-9c84-7b074e1e8273 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:00.108754 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-58e96a5f-7f87-4293-9c84-7b074e1e8273 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:00.296528 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-1be1e960-5646-4a41-8abe-9e9e6c5b486d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:53:00.300414 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-58e96a5f-7f87-4293-9c84-7b074e1e8273 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:53:00.304507 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-1be1e960-5646-4a41-8abe-9e9e6c5b486d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1522 microversion: 2.1 time: 0.216919 Sep 20 04:53:00.305229 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 90/159] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:00 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:53:00.308079 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-58e96a5f-7f87-4293-9c84-7b074e1e8273 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab" status: 200 len: 1368 microversion: 2.1 time: 0.213512 Sep 20 04:53:00.308650 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 70/160] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:00 2022] GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab => generated 1368 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:53:01.326972 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-80c78d59-5bb8-4a23-9045-6f037be4cfa2 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:01.327669 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-80c78d59-5bb8-4a23-9045-6f037be4cfa2 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:01.331230 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-40329a33-fc23-4e60-8f5a-eb9d10a27e3e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:01.331839 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-40329a33-fc23-4e60-8f5a-eb9d10a27e3e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:01.333604 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-80c78d59-5bb8-4a23-9045-6f037be4cfa2 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:01.334089 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-80c78d59-5bb8-4a23-9045-6f037be4cfa2 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:01.334524 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-80c78d59-5bb8-4a23-9045-6f037be4cfa2 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:01.335793 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-80c78d59-5bb8-4a23-9045-6f037be4cfa2 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:01.336240 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-80c78d59-5bb8-4a23-9045-6f037be4cfa2 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:01.336684 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-80c78d59-5bb8-4a23-9045-6f037be4cfa2 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:01.338692 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-40329a33-fc23-4e60-8f5a-eb9d10a27e3e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:01.339160 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-40329a33-fc23-4e60-8f5a-eb9d10a27e3e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:01.339586 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-40329a33-fc23-4e60-8f5a-eb9d10a27e3e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:01.340257 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-40329a33-fc23-4e60-8f5a-eb9d10a27e3e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:01.340729 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-40329a33-fc23-4e60-8f5a-eb9d10a27e3e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:01.341143 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-40329a33-fc23-4e60-8f5a-eb9d10a27e3e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:01.544337 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-80c78d59-5bb8-4a23-9045-6f037be4cfa2 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:53:01.552416 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-40329a33-fc23-4e60-8f5a-eb9d10a27e3e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:53:01.552589 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-80c78d59-5bb8-4a23-9045-6f037be4cfa2 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1522 microversion: 2.1 time: 0.229474 Sep 20 04:53:01.555582 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 91/161] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:01 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:53:01.560965 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-40329a33-fc23-4e60-8f5a-eb9d10a27e3e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab" status: 200 len: 1368 microversion: 2.1 time: 0.233887 Sep 20 04:53:01.561528 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 71/162] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:01 2022] GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab => generated 1368 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:53:02.577989 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-9a7b8070-18bf-4dbb-9f8b-d3781ebf0223 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:02.583342 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-e20831de-c3fb-4e25-b424-3f8ce2e68ac3 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:02.584341 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-9a7b8070-18bf-4dbb-9f8b-d3781ebf0223 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:02.584831 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-e20831de-c3fb-4e25-b424-3f8ce2e68ac3 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:02.596298 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-e20831de-c3fb-4e25-b424-3f8ce2e68ac3 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:02.597746 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9a7b8070-18bf-4dbb-9f8b-d3781ebf0223 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:02.598311 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9a7b8070-18bf-4dbb-9f8b-d3781ebf0223 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:02.598906 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-e20831de-c3fb-4e25-b424-3f8ce2e68ac3 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:02.599306 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9a7b8070-18bf-4dbb-9f8b-d3781ebf0223 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:02.599847 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-e20831de-c3fb-4e25-b424-3f8ce2e68ac3 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:02.600623 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9a7b8070-18bf-4dbb-9f8b-d3781ebf0223 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:02.601437 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-e20831de-c3fb-4e25-b424-3f8ce2e68ac3 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:02.601995 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9a7b8070-18bf-4dbb-9f8b-d3781ebf0223 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:02.602605 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9a7b8070-18bf-4dbb-9f8b-d3781ebf0223 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:02.606818 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-e20831de-c3fb-4e25-b424-3f8ce2e68ac3 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:02.607440 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-e20831de-c3fb-4e25-b424-3f8ce2e68ac3 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:02.815597 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-e20831de-c3fb-4e25-b424-3f8ce2e68ac3 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:53:02.822309 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-9a7b8070-18bf-4dbb-9f8b-d3781ebf0223 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:53:02.823463 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-e20831de-c3fb-4e25-b424-3f8ce2e68ac3 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab" status: 200 len: 1368 microversion: 2.1 time: 0.243868 Sep 20 04:53:02.824037 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 72/163] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:02 2022] GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab => generated 1368 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:53:02.830733 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-9a7b8070-18bf-4dbb-9f8b-d3781ebf0223 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1522 microversion: 2.1 time: 0.256194 Sep 20 04:53:02.831303 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 92/164] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:02 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:53:03.860823 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-b03de6a7-d9ed-45ff-9cfd-d9a32044d424 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:03.860823 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-b03de6a7-d9ed-45ff-9cfd-d9a32044d424 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:03.861366 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-e7a99b72-8f04-4d24-bfac-8996002f61d0 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:03.861366 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-e7a99b72-8f04-4d24-bfac-8996002f61d0 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:03.861789 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-b03de6a7-d9ed-45ff-9cfd-d9a32044d424 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:03.861789 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-b03de6a7-d9ed-45ff-9cfd-d9a32044d424 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:03.861944 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e7a99b72-8f04-4d24-bfac-8996002f61d0 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:03.862040 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-b03de6a7-d9ed-45ff-9cfd-d9a32044d424 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:03.862126 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e7a99b72-8f04-4d24-bfac-8996002f61d0 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:03.862126 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e7a99b72-8f04-4d24-bfac-8996002f61d0 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:03.862446 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-b03de6a7-d9ed-45ff-9cfd-d9a32044d424 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:03.862861 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e7a99b72-8f04-4d24-bfac-8996002f61d0 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:03.863425 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-b03de6a7-d9ed-45ff-9cfd-d9a32044d424 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:03.863538 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e7a99b72-8f04-4d24-bfac-8996002f61d0 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:03.863851 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e7a99b72-8f04-4d24-bfac-8996002f61d0 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:03.864337 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-b03de6a7-d9ed-45ff-9cfd-d9a32044d424 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:04.109417 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-e7a99b72-8f04-4d24-bfac-8996002f61d0 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:53:04.125427 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-e7a99b72-8f04-4d24-bfac-8996002f61d0 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1522 microversion: 2.1 time: 0.275698 Sep 20 04:53:04.126036 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 93/165] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:03 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:53:04.134236 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-b03de6a7-d9ed-45ff-9cfd-d9a32044d424 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:53:04.143009 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-b03de6a7-d9ed-45ff-9cfd-d9a32044d424 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab" status: 200 len: 1558 microversion: 2.1 time: 0.300383 Sep 20 04:53:04.143582 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 73/166] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:03 2022] GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab => generated 1558 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:53:04.166695 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-c5642b3d-b77c-4284-97ba-d53f555456fa tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:04.167351 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-c5642b3d-b77c-4284-97ba-d53f555456fa tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:04.173205 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c5642b3d-b77c-4284-97ba-d53f555456fa tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:04.173689 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c5642b3d-b77c-4284-97ba-d53f555456fa tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:04.174117 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c5642b3d-b77c-4284-97ba-d53f555456fa tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:04.174805 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c5642b3d-b77c-4284-97ba-d53f555456fa tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:04.175249 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c5642b3d-b77c-4284-97ba-d53f555456fa tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:04.175664 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c5642b3d-b77c-4284-97ba-d53f555456fa tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:04.301416 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-c5642b3d-b77c-4284-97ba-d53f555456fa tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.138546 Sep 20 04:53:04.302079 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 94/167] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Sep 20 04:53:04 2022] GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab/os-interface => generated 284 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:53:05.153128 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-c4108a9a-250b-482c-8738-73c04fe0144b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:05.154354 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-c4108a9a-250b-482c-8738-73c04fe0144b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:05.165457 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-c4108a9a-250b-482c-8738-73c04fe0144b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:05.166207 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-c4108a9a-250b-482c-8738-73c04fe0144b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:05.167657 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-c4108a9a-250b-482c-8738-73c04fe0144b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:05.168556 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-c4108a9a-250b-482c-8738-73c04fe0144b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:05.172265 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-c4108a9a-250b-482c-8738-73c04fe0144b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:05.172966 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-c4108a9a-250b-482c-8738-73c04fe0144b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:05.182865 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG dbcounter [-] [126814] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:05.358970 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-b2277895-e6af-4fe5-ac9f-8ee6c4527c1a tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:05.360163 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-b2277895-e6af-4fe5-ac9f-8ee6c4527c1a tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] [instance: 033b2f0d-760f-467a-9b3b-e7a8f2196aa7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:05.368320 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b2277895-e6af-4fe5-ac9f-8ee6c4527c1a tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:05.368995 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b2277895-e6af-4fe5-ac9f-8ee6c4527c1a tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:05.369575 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b2277895-e6af-4fe5-ac9f-8ee6c4527c1a tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:05.370414 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b2277895-e6af-4fe5-ac9f-8ee6c4527c1a tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:05.371098 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b2277895-e6af-4fe5-ac9f-8ee6c4527c1a tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:05.371690 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b2277895-e6af-4fe5-ac9f-8ee6c4527c1a tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:05.402091 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-b2277895-e6af-4fe5-ac9f-8ee6c4527c1a tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] [instance: 033b2f0d-760f-467a-9b3b-e7a8f2196aa7] Going to try to terminate instance {{(pid=126813) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 20 04:53:05.559870 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-b2277895-e6af-4fe5-ac9f-8ee6c4527c1a tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] 10.222.0.27 "DELETE /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7" status: 204 len: 0 microversion: 2.1 time: 0.205862 Sep 20 04:53:05.561815 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 95/168] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Sep 20 04:53:05 2022] DELETE /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 20 04:53:05.567348 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-c4108a9a-250b-482c-8738-73c04fe0144b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:53:05.579682 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-6874ef66-473e-4058-9745-106c0555981e tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:05.581891 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-6874ef66-473e-4058-9745-106c0555981e tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] [instance: 033b2f0d-760f-467a-9b3b-e7a8f2196aa7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:05.592660 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6874ef66-473e-4058-9745-106c0555981e tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:05.593161 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6874ef66-473e-4058-9745-106c0555981e tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:05.593592 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6874ef66-473e-4058-9745-106c0555981e tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:05.594432 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-c4108a9a-250b-482c-8738-73c04fe0144b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1522 microversion: 2.1 time: 0.442960 Sep 20 04:53:05.594844 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6874ef66-473e-4058-9745-106c0555981e tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:05.595296 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6874ef66-473e-4058-9745-106c0555981e tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:05.595718 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6874ef66-473e-4058-9745-106c0555981e tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:05.599045 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 74/169] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:05 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1522 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:53:05.827871 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-6874ef66-473e-4058-9745-106c0555981e tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77211762af4cc9b4f0a2f74ac3ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa7ea3cb69454797bd7956e12f2a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:53:05.838874 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-6874ef66-473e-4058-9745-106c0555981e tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] 10.222.0.27 "GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7" status: 200 len: 1554 microversion: 2.1 time: 0.271519 Sep 20 04:53:05.840816 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 96/170] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:05 2022] GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7 => generated 1554 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:53:06.263868 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [req-6266c8fe-76b6-488a-b1ee-f0c7fbf8a19a req-c20f9ad0-8f25-48fd-be56-05a1bbecaa04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7723784c-51e5-4936-b33a-caf9b1b87bab", "tag": "4e821eae-4814-40c5-b31f-2ea37b73d8f1"}]} {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:53:06.284683 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [req-6266c8fe-76b6-488a-b1ee-f0c7fbf8a19a req-c20f9ad0-8f25-48fd-be56-05a1bbecaa04 service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:06.287600 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [req-6266c8fe-76b6-488a-b1ee-f0c7fbf8a19a req-c20f9ad0-8f25-48fd-be56-05a1bbecaa04 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:06.289634 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [req-6266c8fe-76b6-488a-b1ee-f0c7fbf8a19a req-c20f9ad0-8f25-48fd-be56-05a1bbecaa04 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:06.328181 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.compute.server_external_events [req-6266c8fe-76b6-488a-b1ee-f0c7fbf8a19a req-c20f9ad0-8f25-48fd-be56-05a1bbecaa04 service nova] Creating event network-changed:4e821eae-4814-40c5-b31f-2ea37b73d8f1 for instance 7723784c-51e5-4936-b33a-caf9b1b87bab on hv-cinder-75671 Sep 20 04:53:06.347120 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [req-6266c8fe-76b6-488a-b1ee-f0c7fbf8a19a req-c20f9ad0-8f25-48fd-be56-05a1bbecaa04 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084045 Sep 20 04:53:06.349782 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 75/171] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 04:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:53:06.619052 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-81622fa7-0496-41b1-9e51-765e29efac94 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:06.620204 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-81622fa7-0496-41b1-9e51-765e29efac94 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:06.629673 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-81622fa7-0496-41b1-9e51-765e29efac94 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:06.630357 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-81622fa7-0496-41b1-9e51-765e29efac94 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:06.632045 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-81622fa7-0496-41b1-9e51-765e29efac94 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:06.641175 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-81622fa7-0496-41b1-9e51-765e29efac94 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:06.642513 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-81622fa7-0496-41b1-9e51-765e29efac94 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:06.644195 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-81622fa7-0496-41b1-9e51-765e29efac94 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:06.862692 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-1e7d0c40-6364-4668-b602-039a5b480e63 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:06.863386 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-1e7d0c40-6364-4668-b602-039a5b480e63 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] [instance: 033b2f0d-760f-467a-9b3b-e7a8f2196aa7] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:06.872202 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-1e7d0c40-6364-4668-b602-039a5b480e63 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:06.872716 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-1e7d0c40-6364-4668-b602-039a5b480e63 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:06.873145 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-1e7d0c40-6364-4668-b602-039a5b480e63 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:06.873839 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-1e7d0c40-6364-4668-b602-039a5b480e63 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:06.874281 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-1e7d0c40-6364-4668-b602-039a5b480e63 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:06.874714 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-1e7d0c40-6364-4668-b602-039a5b480e63 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:06.931257 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-81622fa7-0496-41b1-9e51-765e29efac94 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:53:06.944882 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-81622fa7-0496-41b1-9e51-765e29efac94 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1522 microversion: 2.1 time: 0.329370 Sep 20 04:53:06.945747 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 97/172] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:06 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1522 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:53:07.147924 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-1e7d0c40-6364-4668-b602-039a5b480e63 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77211762af4cc9b4f0a2f74ac3ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa7ea3cb69454797bd7956e12f2a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:53:07.158550 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-1e7d0c40-6364-4668-b602-039a5b480e63 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] 10.222.0.27 "GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7" status: 200 len: 1554 microversion: 2.1 time: 0.299998 Sep 20 04:53:07.159134 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 76/173] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:06 2022] GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7 => generated 1554 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:53:07.972150 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-c54aa9af-a5a9-4c0d-b184-f9dc7d1fcf38 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:07.973539 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-c54aa9af-a5a9-4c0d-b184-f9dc7d1fcf38 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:07.987178 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c54aa9af-a5a9-4c0d-b184-f9dc7d1fcf38 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:07.987945 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c54aa9af-a5a9-4c0d-b184-f9dc7d1fcf38 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:07.988674 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c54aa9af-a5a9-4c0d-b184-f9dc7d1fcf38 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:07.989724 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c54aa9af-a5a9-4c0d-b184-f9dc7d1fcf38 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:07.990924 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c54aa9af-a5a9-4c0d-b184-f9dc7d1fcf38 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:07.991601 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c54aa9af-a5a9-4c0d-b184-f9dc7d1fcf38 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:08.182988 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-4ab1f26f-5259-48d2-af76-bce39a4dd280 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:08.184167 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-4ab1f26f-5259-48d2-af76-bce39a4dd280 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] [instance: 033b2f0d-760f-467a-9b3b-e7a8f2196aa7] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:08.199720 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-4ab1f26f-5259-48d2-af76-bce39a4dd280 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:08.199720 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-4ab1f26f-5259-48d2-af76-bce39a4dd280 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:08.199720 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-4ab1f26f-5259-48d2-af76-bce39a4dd280 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:08.200886 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-4ab1f26f-5259-48d2-af76-bce39a4dd280 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:08.201362 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-4ab1f26f-5259-48d2-af76-bce39a4dd280 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:08.212319 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-4ab1f26f-5259-48d2-af76-bce39a4dd280 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:08.868472 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-4ab1f26f-5259-48d2-af76-bce39a4dd280 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77211762af4cc9b4f0a2f74ac3ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa7ea3cb69454797bd7956e12f2a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:53:08.886172 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-4ab1f26f-5259-48d2-af76-bce39a4dd280 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] 10.222.0.27 "GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7" status: 200 len: 1554 microversion: 2.1 time: 0.705659 Sep 20 04:53:08.889593 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 77/174] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:08 2022] GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7 => generated 1554 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:53:08.942153 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-c54aa9af-a5a9-4c0d-b184-f9dc7d1fcf38 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:53:08.953368 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-c54aa9af-a5a9-4c0d-b184-f9dc7d1fcf38 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1522 microversion: 2.1 time: 0.986147 Sep 20 04:53:08.954208 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 98/175] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:07 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1522 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:53:09.182477 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [req-6145f88f-8b3a-4ccb-8100-3783a2a640b0 req-b2f160ff-5f0b-4945-9567-56686528e19e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "033b2f0d-760f-467a-9b3b-e7a8f2196aa7", "name": "network-vif-deleted", "tag": "46aec430-a166-4d48-b4d3-8dc05c3ee484"}]} {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:53:09.200659 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [req-6145f88f-8b3a-4ccb-8100-3783a2a640b0 req-b2f160ff-5f0b-4945-9567-56686528e19e service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:09.206625 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [req-6145f88f-8b3a-4ccb-8100-3783a2a640b0 req-b2f160ff-5f0b-4945-9567-56686528e19e service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:09.207965 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [req-6145f88f-8b3a-4ccb-8100-3783a2a640b0 req-b2f160ff-5f0b-4945-9567-56686528e19e service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:09.236245 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.compute.server_external_events [req-6145f88f-8b3a-4ccb-8100-3783a2a640b0 req-b2f160ff-5f0b-4945-9567-56686528e19e service nova] Creating event network-vif-deleted:46aec430-a166-4d48-b4d3-8dc05c3ee484 for instance 033b2f0d-760f-467a-9b3b-e7a8f2196aa7 on hv-cinder-75671 Sep 20 04:53:09.257262 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [req-6145f88f-8b3a-4ccb-8100-3783a2a640b0 req-b2f160ff-5f0b-4945-9567-56686528e19e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082151 Sep 20 04:53:09.260331 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 78/176] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 04:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:53:09.923111 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-6199ac2d-6766-4d1b-bc25-330383394ddc tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:09.925344 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-6199ac2d-6766-4d1b-bc25-330383394ddc tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] [instance: 033b2f0d-760f-467a-9b3b-e7a8f2196aa7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:09.938044 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6199ac2d-6766-4d1b-bc25-330383394ddc tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:09.938534 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6199ac2d-6766-4d1b-bc25-330383394ddc tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:09.939222 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6199ac2d-6766-4d1b-bc25-330383394ddc tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:09.940025 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6199ac2d-6766-4d1b-bc25-330383394ddc tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:09.940524 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6199ac2d-6766-4d1b-bc25-330383394ddc tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:09.940989 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6199ac2d-6766-4d1b-bc25-330383394ddc tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:09.981348 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-338ce3de-3a72-45b8-bab8-232d4a6ff80d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:09.982042 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-338ce3de-3a72-45b8-bab8-232d4a6ff80d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:09.995907 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-338ce3de-3a72-45b8-bab8-232d4a6ff80d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:09.996408 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-338ce3de-3a72-45b8-bab8-232d4a6ff80d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:09.996886 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-338ce3de-3a72-45b8-bab8-232d4a6ff80d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:09.997594 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-338ce3de-3a72-45b8-bab8-232d4a6ff80d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:09.998036 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-338ce3de-3a72-45b8-bab8-232d4a6ff80d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:10.002924 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-338ce3de-3a72-45b8-bab8-232d4a6ff80d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:10.034428 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6199ac2d-6766-4d1b-bc25-330383394ddc tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:10.035276 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6199ac2d-6766-4d1b-bc25-330383394ddc tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:10.035995 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6199ac2d-6766-4d1b-bc25-330383394ddc tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:10.036940 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.objects.instance [None req-6199ac2d-6766-4d1b-bc25-330383394ddc tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lazy-loading 'fault' on Instance uuid 033b2f0d-760f-467a-9b3b-e7a8f2196aa7 {{(pid=126813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 04:53:10.139787 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-6199ac2d-6766-4d1b-bc25-330383394ddc tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a77211762af4cc9b4f0a2f74ac3ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa7ea3cb69454797bd7956e12f2a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:53:10.153500 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-6199ac2d-6766-4d1b-bc25-330383394ddc tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] 10.222.0.27 "GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7" status: 200 len: 1517 microversion: 2.1 time: 0.245851 Sep 20 04:53:10.154318 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 99/177] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:09 2022] GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7 => generated 1517 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:53:10.225661 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-338ce3de-3a72-45b8-bab8-232d4a6ff80d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:53:10.234649 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-338ce3de-3a72-45b8-bab8-232d4a6ff80d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1522 microversion: 2.1 time: 0.257707 Sep 20 04:53:10.236032 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 79/178] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:09 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:53:11.177488 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-ea2d2deb-9f5e-483c-9818-238a6f752cd9 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:11.179358 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-ea2d2deb-9f5e-483c-9818-238a6f752cd9 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] [instance: 033b2f0d-760f-467a-9b3b-e7a8f2196aa7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:11.187318 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ea2d2deb-9f5e-483c-9818-238a6f752cd9 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:11.187802 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ea2d2deb-9f5e-483c-9818-238a6f752cd9 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:11.188235 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ea2d2deb-9f5e-483c-9818-238a6f752cd9 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:11.188963 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ea2d2deb-9f5e-483c-9818-238a6f752cd9 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:11.189447 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ea2d2deb-9f5e-483c-9818-238a6f752cd9 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:11.189901 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ea2d2deb-9f5e-483c-9818-238a6f752cd9 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:11.206957 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.wsgi [None req-ea2d2deb-9f5e-483c-9818-238a6f752cd9 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] HTTP exception thrown: Instance 033b2f0d-760f-467a-9b3b-e7a8f2196aa7 could not be found. Sep 20 04:53:11.211661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-ea2d2deb-9f5e-483c-9818-238a6f752cd9 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Request method failure captured: Sep 20 04:53:11.211661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: request: GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7 HTTP/1.1 Sep 20 04:53:11.211661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept: application/json Sep 20 04:53:11.211661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept-Encoding: identity Sep 20 04:53:11.211661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Connection: close Sep 20 04:53:11.211661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Length: 0 Sep 20 04:53:11.211661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Type: application/json Sep 20 04:53:11.211661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Host: 10.222.0.27 Sep 20 04:53:11.211661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Openstack-System-Scope: None Sep 20 04:53:11.211661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: User-Agent: python-urllib3/1.26.12 Sep 20 04:53:11.211661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Auth-Token: gAAAAABjKUbouv5lKEmcHZiAvvexlzj6FOHrb5GYDQcPe7Ei1zSXlvBmlgU67KV11HyCGhds6TOgbXTykQbZtouamh7fhUV7POnwAmcoPJVxfM6-vlscZwwDXPc5XSOPcwZ_rXnSwzR7rHsZCDgUAXvHeiHhYzGjpVtxXxp17kHTd6N0xuv79C4 Sep 20 04:53:11.211661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Id: None Sep 20 04:53:11.211661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Name: None Sep 20 04:53:11.211661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Identity-Status: Confirmed Sep 20 04:53:11.211661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Is-Admin-Project: True Sep 20 04:53:11.211661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Id: default Sep 20 04:53:11.211661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Name: Default Sep 20 04:53:11.211661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Id: 72aa7ea3cb69454797bd7956e12f2a5e Sep 20 04:53:11.211661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Name: tempest-DeleteServersTestJSON-1803604471 Sep 20 04:53:11.211661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Role: reader,member Sep 20 04:53:11.211661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Roles: reader,member Sep 20 04:53:11.213132 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/72aa7ea3cb69454797bd7956e12f2a5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/72aa7ea3cb69454797bd7956e12f2a5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_72aa7ea3cb69454797bd7956e12f2a5e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/72aa7ea3cb69454797bd7956e12f2a5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 04:53:11.213132 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant: tempest-DeleteServersTestJSON-1803604471 Sep 20 04:53:11.213132 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Id: 72aa7ea3cb69454797bd7956e12f2a5e Sep 20 04:53:11.213132 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Name: tempest-DeleteServersTestJSON-1803604471 Sep 20 04:53:11.213132 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User: tempest-DeleteServersTestJSON-1803604471-project Sep 20 04:53:11.213132 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Id: default Sep 20 04:53:11.213132 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Name: Default Sep 20 04:53:11.213132 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Id: 3a77211762af4cc9b4f0a2f74ac3ae1d Sep 20 04:53:11.213132 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Name: tempest-DeleteServersTestJSON-1803604471-project Sep 20 04:53:11.213132 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: method: > Sep 20 04:53:11.213132 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: exception: Instance 033b2f0d-760f-467a-9b3b-e7a8f2196aa7 could not be found. Sep 20 04:53:11.213132 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: action_args: {'id': '033b2f0d-760f-467a-9b3b-e7a8f2196aa7'} Sep 20 04:53:11.213896 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 04:53:11.213896 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:53:11.213896 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 04:53:11.213896 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 04:53:11.213896 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 04:53:11.213896 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 04:53:11.213896 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 04:53:11.213896 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 04:53:11.213896 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 04:53:11.213896 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 04:53:11.213896 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 033b2f0d-760f-467a-9b3b-e7a8f2196aa7 could not be found. Sep 20 04:53:11.213896 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:53:11.213896 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:53:11.213896 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:53:11.213896 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:53:11.213896 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:53:11.213896 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:53:11.213896 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 04:53:11.213896 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 04:53:11.213896 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 04:53:11.214989 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 04:53:11.214989 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 04:53:11.214989 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 04:53:11.214989 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 04:53:11.214989 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 04:53:11.214989 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 04:53:11.214989 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 04:53:11.214989 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 033b2f0d-760f-467a-9b3b-e7a8f2196aa7 could not be found. Sep 20 04:53:11.214989 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:53:11.214989 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:53:11.214989 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:53:11.214989 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:53:11.214989 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:53:11.214989 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:53:11.214989 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 04:53:11.214989 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 04:53:11.214989 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 033b2f0d-760f-467a-9b3b-e7a8f2196aa7 could not be found. Sep 20 04:53:11.214989 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:53:11.215948 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-ea2d2deb-9f5e-483c-9818-238a6f752cd9 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Returning 404 to user: Instance 033b2f0d-760f-467a-9b3b-e7a8f2196aa7 could not be found. {{(pid=126813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 04:53:11.215948 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-ea2d2deb-9f5e-483c-9818-238a6f752cd9 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] 10.222.0.27 "GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7" status: 404 len: 111 microversion: 2.1 time: 0.040151 Sep 20 04:53:11.215948 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 100/179] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:11 2022] GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 20 04:53:11.258576 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-14a762d7-7ac0-4080-9696-37409d26e008 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:11.259926 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-14a762d7-7ac0-4080-9696-37409d26e008 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:11.268531 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-14a762d7-7ac0-4080-9696-37409d26e008 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:11.269235 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-14a762d7-7ac0-4080-9696-37409d26e008 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:11.269737 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-14a762d7-7ac0-4080-9696-37409d26e008 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:11.270757 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-14a762d7-7ac0-4080-9696-37409d26e008 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:11.271305 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-14a762d7-7ac0-4080-9696-37409d26e008 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:11.271821 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-14a762d7-7ac0-4080-9696-37409d26e008 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:11.365559 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-910b9606-9949-41b8-b95f-a9475e742904 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:11.368158 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-910b9606-9949-41b8-b95f-a9475e742904 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] [instance: 033b2f0d-760f-467a-9b3b-e7a8f2196aa7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:11.376147 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-910b9606-9949-41b8-b95f-a9475e742904 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:11.376660 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-910b9606-9949-41b8-b95f-a9475e742904 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:11.378100 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-910b9606-9949-41b8-b95f-a9475e742904 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:11.379966 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-910b9606-9949-41b8-b95f-a9475e742904 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:11.380429 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-910b9606-9949-41b8-b95f-a9475e742904 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:11.381106 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-910b9606-9949-41b8-b95f-a9475e742904 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:11.404888 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.wsgi [None req-910b9606-9949-41b8-b95f-a9475e742904 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] HTTP exception thrown: Instance 033b2f0d-760f-467a-9b3b-e7a8f2196aa7 could not be found. Sep 20 04:53:11.406615 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-910b9606-9949-41b8-b95f-a9475e742904 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Request method failure captured: Sep 20 04:53:11.406615 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: request: GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7/os-volume_attachments HTTP/1.1 Sep 20 04:53:11.406615 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept: application/json Sep 20 04:53:11.406615 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept-Encoding: identity Sep 20 04:53:11.406615 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Connection: close Sep 20 04:53:11.406615 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Length: 0 Sep 20 04:53:11.406615 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Type: application/json Sep 20 04:53:11.406615 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Host: 10.222.0.27 Sep 20 04:53:11.406615 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Openstack-System-Scope: None Sep 20 04:53:11.406615 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: User-Agent: python-urllib3/1.26.12 Sep 20 04:53:11.406615 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Auth-Token: gAAAAABjKUbouv5lKEmcHZiAvvexlzj6FOHrb5GYDQcPe7Ei1zSXlvBmlgU67KV11HyCGhds6TOgbXTykQbZtouamh7fhUV7POnwAmcoPJVxfM6-vlscZwwDXPc5XSOPcwZ_rXnSwzR7rHsZCDgUAXvHeiHhYzGjpVtxXxp17kHTd6N0xuv79C4 Sep 20 04:53:11.406615 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Id: None Sep 20 04:53:11.406615 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Name: None Sep 20 04:53:11.406615 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Identity-Status: Confirmed Sep 20 04:53:11.406615 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Is-Admin-Project: True Sep 20 04:53:11.406615 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Id: default Sep 20 04:53:11.406615 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Name: Default Sep 20 04:53:11.406615 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Id: 72aa7ea3cb69454797bd7956e12f2a5e Sep 20 04:53:11.406615 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Name: tempest-DeleteServersTestJSON-1803604471 Sep 20 04:53:11.406615 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Role: reader,member Sep 20 04:53:11.406615 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Roles: reader,member Sep 20 04:53:11.408016 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/72aa7ea3cb69454797bd7956e12f2a5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/72aa7ea3cb69454797bd7956e12f2a5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_72aa7ea3cb69454797bd7956e12f2a5e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/72aa7ea3cb69454797bd7956e12f2a5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 04:53:11.408016 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant: tempest-DeleteServersTestJSON-1803604471 Sep 20 04:53:11.408016 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Id: 72aa7ea3cb69454797bd7956e12f2a5e Sep 20 04:53:11.408016 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Name: tempest-DeleteServersTestJSON-1803604471 Sep 20 04:53:11.408016 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User: tempest-DeleteServersTestJSON-1803604471-project Sep 20 04:53:11.408016 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Id: default Sep 20 04:53:11.408016 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Name: Default Sep 20 04:53:11.408016 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Id: 3a77211762af4cc9b4f0a2f74ac3ae1d Sep 20 04:53:11.408016 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Name: tempest-DeleteServersTestJSON-1803604471-project Sep 20 04:53:11.408016 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: method: > Sep 20 04:53:11.408016 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: exception: Instance 033b2f0d-760f-467a-9b3b-e7a8f2196aa7 could not be found. Sep 20 04:53:11.408016 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: action_args: {'server_id': '033b2f0d-760f-467a-9b3b-e7a8f2196aa7'} Sep 20 04:53:11.408834 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 04:53:11.408834 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:53:11.408834 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 04:53:11.408834 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 04:53:11.408834 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 04:53:11.408834 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 04:53:11.408834 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 04:53:11.408834 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 04:53:11.408834 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 04:53:11.408834 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 04:53:11.408834 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 033b2f0d-760f-467a-9b3b-e7a8f2196aa7 could not be found. Sep 20 04:53:11.408834 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:53:11.408834 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:53:11.408834 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:53:11.408834 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:53:11.408834 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:53:11.408834 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:53:11.408834 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 04:53:11.408834 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 04:53:11.408834 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 04:53:11.410066 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 04:53:11.410066 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 20 04:53:11.410066 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 20 04:53:11.410066 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 20 04:53:11.410066 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 20 04:53:11.410066 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 20 04:53:11.410066 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 20 04:53:11.410066 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 04:53:11.410066 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 04:53:11.410066 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 033b2f0d-760f-467a-9b3b-e7a8f2196aa7 could not be found. Sep 20 04:53:11.410066 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:53:11.410066 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:53:11.410066 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:53:11.410066 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:53:11.410066 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:53:11.410066 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:53:11.410066 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 04:53:11.410066 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 04:53:11.410066 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 033b2f0d-760f-467a-9b3b-e7a8f2196aa7 could not be found. Sep 20 04:53:11.410066 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:53:11.411993 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-910b9606-9949-41b8-b95f-a9475e742904 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Returning 404 to user: Instance 033b2f0d-760f-467a-9b3b-e7a8f2196aa7 could not be found. {{(pid=126813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 04:53:11.423786 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-910b9606-9949-41b8-b95f-a9475e742904 tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] 10.222.0.27 "GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.053026 Sep 20 04:53:11.424450 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 101/180] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Sep 20 04:53:11 2022] GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7/os-volume_attachments => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 20 04:53:11.499582 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-14a762d7-7ac0-4080-9696-37409d26e008 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:53:11.534448 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-14a762d7-7ac0-4080-9696-37409d26e008 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1522 microversion: 2.1 time: 0.278450 Sep 20 04:53:11.535417 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 80/181] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:11 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:53:12.567105 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-55723d48-da36-4af4-9606-29fc6ad2109a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:12.567796 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-55723d48-da36-4af4-9606-29fc6ad2109a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:12.574366 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-55723d48-da36-4af4-9606-29fc6ad2109a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:12.574916 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-55723d48-da36-4af4-9606-29fc6ad2109a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:12.575548 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-55723d48-da36-4af4-9606-29fc6ad2109a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:12.576239 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-55723d48-da36-4af4-9606-29fc6ad2109a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:12.576712 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-55723d48-da36-4af4-9606-29fc6ad2109a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:12.577133 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-55723d48-da36-4af4-9606-29fc6ad2109a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:12.721708 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-e58481eb-9096-40c9-b700-7e7d03565fdb tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:12.722203 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-e58481eb-9096-40c9-b700-7e7d03565fdb tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] [instance: 033b2f0d-760f-467a-9b3b-e7a8f2196aa7] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:12.729067 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-e58481eb-9096-40c9-b700-7e7d03565fdb tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:12.729628 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-e58481eb-9096-40c9-b700-7e7d03565fdb tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:12.731973 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-e58481eb-9096-40c9-b700-7e7d03565fdb tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:12.732725 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-e58481eb-9096-40c9-b700-7e7d03565fdb tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:12.733186 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-e58481eb-9096-40c9-b700-7e7d03565fdb tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:12.733612 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-e58481eb-9096-40c9-b700-7e7d03565fdb tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:12.744495 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-55723d48-da36-4af4-9606-29fc6ad2109a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:53:12.749573 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.wsgi [None req-e58481eb-9096-40c9-b700-7e7d03565fdb tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] HTTP exception thrown: Instance 033b2f0d-760f-467a-9b3b-e7a8f2196aa7 could not be found. Sep 20 04:53:12.754072 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-55723d48-da36-4af4-9606-29fc6ad2109a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1522 microversion: 2.1 time: 0.193642 Sep 20 04:53:12.754838 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 102/182] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:12 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:53:12.756973 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-e58481eb-9096-40c9-b700-7e7d03565fdb tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Request method failure captured: Sep 20 04:53:12.756973 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: request: DELETE /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7 HTTP/1.1 Sep 20 04:53:12.756973 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: Accept: application/json Sep 20 04:53:12.756973 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: Accept-Encoding: identity Sep 20 04:53:12.756973 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: Connection: close Sep 20 04:53:12.756973 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: Content-Length: 0 Sep 20 04:53:12.756973 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: Content-Type: application/json Sep 20 04:53:12.756973 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: Host: 10.222.0.27 Sep 20 04:53:12.756973 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: Openstack-System-Scope: None Sep 20 04:53:12.756973 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: User-Agent: python-urllib3/1.26.12 Sep 20 04:53:12.756973 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Auth-Token: gAAAAABjKUbouv5lKEmcHZiAvvexlzj6FOHrb5GYDQcPe7Ei1zSXlvBmlgU67KV11HyCGhds6TOgbXTykQbZtouamh7fhUV7POnwAmcoPJVxfM6-vlscZwwDXPc5XSOPcwZ_rXnSwzR7rHsZCDgUAXvHeiHhYzGjpVtxXxp17kHTd6N0xuv79C4 Sep 20 04:53:12.756973 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Domain-Id: None Sep 20 04:53:12.756973 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Domain-Name: None Sep 20 04:53:12.756973 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Identity-Status: Confirmed Sep 20 04:53:12.756973 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Is-Admin-Project: True Sep 20 04:53:12.756973 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Project-Domain-Id: default Sep 20 04:53:12.756973 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Project-Domain-Name: Default Sep 20 04:53:12.756973 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Project-Id: 72aa7ea3cb69454797bd7956e12f2a5e Sep 20 04:53:12.756973 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Project-Name: tempest-DeleteServersTestJSON-1803604471 Sep 20 04:53:12.756973 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Role: reader,member Sep 20 04:53:12.756973 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Roles: reader,member Sep 20 04:53:12.758162 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/72aa7ea3cb69454797bd7956e12f2a5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/72aa7ea3cb69454797bd7956e12f2a5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_72aa7ea3cb69454797bd7956e12f2a5e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/72aa7ea3cb69454797bd7956e12f2a5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 04:53:12.758162 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Tenant: tempest-DeleteServersTestJSON-1803604471 Sep 20 04:53:12.758162 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Tenant-Id: 72aa7ea3cb69454797bd7956e12f2a5e Sep 20 04:53:12.758162 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Tenant-Name: tempest-DeleteServersTestJSON-1803604471 Sep 20 04:53:12.758162 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-User: tempest-DeleteServersTestJSON-1803604471-project Sep 20 04:53:12.758162 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-User-Domain-Id: default Sep 20 04:53:12.758162 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-User-Domain-Name: Default Sep 20 04:53:12.758162 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-User-Id: 3a77211762af4cc9b4f0a2f74ac3ae1d Sep 20 04:53:12.758162 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-User-Name: tempest-DeleteServersTestJSON-1803604471-project Sep 20 04:53:12.758162 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: method: > Sep 20 04:53:12.758162 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: exception: Instance 033b2f0d-760f-467a-9b3b-e7a8f2196aa7 could not be found. Sep 20 04:53:12.758162 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: action_args: {'id': '033b2f0d-760f-467a-9b3b-e7a8f2196aa7'} Sep 20 04:53:12.758826 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 04:53:12.758826 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:53:12.758826 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 04:53:12.758826 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 04:53:12.758826 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 04:53:12.758826 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 04:53:12.758826 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 04:53:12.758826 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 04:53:12.758826 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 04:53:12.758826 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 04:53:12.758826 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 033b2f0d-760f-467a-9b3b-e7a8f2196aa7 could not be found. Sep 20 04:53:12.758826 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi Sep 20 04:53:12.758826 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:53:12.758826 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi Sep 20 04:53:12.758826 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:53:12.758826 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:53:12.758826 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:53:12.758826 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 04:53:12.758826 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 04:53:12.758826 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 04:53:12.759960 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 04:53:12.759960 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 20 04:53:12.759960 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 20 04:53:12.759960 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 20 04:53:12.759960 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 20 04:53:12.759960 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 04:53:12.759960 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 04:53:12.759960 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 04:53:12.759960 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 04:53:12.759960 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 033b2f0d-760f-467a-9b3b-e7a8f2196aa7 could not be found. Sep 20 04:53:12.759960 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi Sep 20 04:53:12.759960 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:53:12.759960 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi Sep 20 04:53:12.759960 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:53:12.759960 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:53:12.759960 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:53:12.759960 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 04:53:12.759960 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 04:53:12.759960 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 033b2f0d-760f-467a-9b3b-e7a8f2196aa7 could not be found. Sep 20 04:53:12.759960 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi Sep 20 04:53:12.761761 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-e58481eb-9096-40c9-b700-7e7d03565fdb tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Returning 404 to user: Instance 033b2f0d-760f-467a-9b3b-e7a8f2196aa7 could not be found. {{(pid=126814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 04:53:12.762737 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-e58481eb-9096-40c9-b700-7e7d03565fdb tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] 10.222.0.27 "DELETE /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7" status: 404 len: 111 microversion: 2.1 time: 0.045080 Sep 20 04:53:12.763689 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 81/183] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Sep 20 04:53:12 2022] DELETE /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 20 04:53:12.773598 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-791fc1f0-dde6-45b7-9405-e116573251ed tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:12.774351 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-791fc1f0-dde6-45b7-9405-e116573251ed tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] [instance: 033b2f0d-760f-467a-9b3b-e7a8f2196aa7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:12.780922 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-791fc1f0-dde6-45b7-9405-e116573251ed tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:12.781705 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-791fc1f0-dde6-45b7-9405-e116573251ed tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:12.782378 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-791fc1f0-dde6-45b7-9405-e116573251ed tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:12.783407 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-791fc1f0-dde6-45b7-9405-e116573251ed tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:12.783977 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-791fc1f0-dde6-45b7-9405-e116573251ed tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:12.784706 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-791fc1f0-dde6-45b7-9405-e116573251ed tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:12.809085 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.wsgi [None req-791fc1f0-dde6-45b7-9405-e116573251ed tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] HTTP exception thrown: Instance 033b2f0d-760f-467a-9b3b-e7a8f2196aa7 could not be found. Sep 20 04:53:12.811149 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-791fc1f0-dde6-45b7-9405-e116573251ed tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Request method failure captured: Sep 20 04:53:12.811149 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: request: GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7 HTTP/1.1 Sep 20 04:53:12.811149 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept: application/json Sep 20 04:53:12.811149 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept-Encoding: identity Sep 20 04:53:12.811149 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Connection: close Sep 20 04:53:12.811149 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Length: 0 Sep 20 04:53:12.811149 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Type: application/json Sep 20 04:53:12.811149 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Host: 10.222.0.27 Sep 20 04:53:12.811149 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Openstack-System-Scope: None Sep 20 04:53:12.811149 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: User-Agent: python-urllib3/1.26.12 Sep 20 04:53:12.811149 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Auth-Token: gAAAAABjKUbouv5lKEmcHZiAvvexlzj6FOHrb5GYDQcPe7Ei1zSXlvBmlgU67KV11HyCGhds6TOgbXTykQbZtouamh7fhUV7POnwAmcoPJVxfM6-vlscZwwDXPc5XSOPcwZ_rXnSwzR7rHsZCDgUAXvHeiHhYzGjpVtxXxp17kHTd6N0xuv79C4 Sep 20 04:53:12.811149 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Id: None Sep 20 04:53:12.811149 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Name: None Sep 20 04:53:12.811149 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Identity-Status: Confirmed Sep 20 04:53:12.811149 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Is-Admin-Project: True Sep 20 04:53:12.811149 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Id: default Sep 20 04:53:12.811149 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Name: Default Sep 20 04:53:12.811149 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Id: 72aa7ea3cb69454797bd7956e12f2a5e Sep 20 04:53:12.811149 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Name: tempest-DeleteServersTestJSON-1803604471 Sep 20 04:53:12.811149 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Role: reader,member Sep 20 04:53:12.811149 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Roles: reader,member Sep 20 04:53:12.812557 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/72aa7ea3cb69454797bd7956e12f2a5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/72aa7ea3cb69454797bd7956e12f2a5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_72aa7ea3cb69454797bd7956e12f2a5e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/72aa7ea3cb69454797bd7956e12f2a5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 04:53:12.812557 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant: tempest-DeleteServersTestJSON-1803604471 Sep 20 04:53:12.812557 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Id: 72aa7ea3cb69454797bd7956e12f2a5e Sep 20 04:53:12.812557 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Name: tempest-DeleteServersTestJSON-1803604471 Sep 20 04:53:12.812557 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User: tempest-DeleteServersTestJSON-1803604471-project Sep 20 04:53:12.812557 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Id: default Sep 20 04:53:12.812557 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Name: Default Sep 20 04:53:12.812557 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Id: 3a77211762af4cc9b4f0a2f74ac3ae1d Sep 20 04:53:12.812557 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Name: tempest-DeleteServersTestJSON-1803604471-project Sep 20 04:53:12.812557 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: method: > Sep 20 04:53:12.812557 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: exception: Instance 033b2f0d-760f-467a-9b3b-e7a8f2196aa7 could not be found. Sep 20 04:53:12.812557 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: action_args: {'id': '033b2f0d-760f-467a-9b3b-e7a8f2196aa7'} Sep 20 04:53:12.813453 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 04:53:12.813453 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:53:12.813453 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 04:53:12.813453 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 04:53:12.813453 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 04:53:12.813453 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 04:53:12.813453 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 04:53:12.813453 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 04:53:12.813453 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 04:53:12.813453 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 04:53:12.813453 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 033b2f0d-760f-467a-9b3b-e7a8f2196aa7 could not be found. Sep 20 04:53:12.813453 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:53:12.813453 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:53:12.813453 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:53:12.813453 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:53:12.813453 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:53:12.813453 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:53:12.813453 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 04:53:12.813453 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 04:53:12.813453 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 04:53:12.814578 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 04:53:12.814578 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 04:53:12.814578 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 04:53:12.814578 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 04:53:12.814578 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 04:53:12.814578 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 04:53:12.814578 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 04:53:12.814578 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 033b2f0d-760f-467a-9b3b-e7a8f2196aa7 could not be found. Sep 20 04:53:12.814578 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:53:12.814578 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:53:12.814578 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:53:12.814578 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:53:12.814578 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:53:12.814578 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:53:12.814578 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 04:53:12.814578 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 04:53:12.814578 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 033b2f0d-760f-467a-9b3b-e7a8f2196aa7 could not be found. Sep 20 04:53:12.814578 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:53:12.816526 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-791fc1f0-dde6-45b7-9405-e116573251ed tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] Returning 404 to user: Instance 033b2f0d-760f-467a-9b3b-e7a8f2196aa7 could not be found. {{(pid=126813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 04:53:12.818024 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-791fc1f0-dde6-45b7-9405-e116573251ed tempest-DeleteServersTestJSON-1803604471 tempest-DeleteServersTestJSON-1803604471-project] 10.222.0.27 "GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7" status: 404 len: 111 microversion: 2.1 time: 0.049493 Sep 20 04:53:12.823462 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 103/184] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:12 2022] GET /compute/v2.1/servers/033b2f0d-760f-467a-9b3b-e7a8f2196aa7 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 20 04:53:13.785637 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-6ddeb235-f8e6-44e1-af52-f0b83bfc3c48 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:13.787170 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-6ddeb235-f8e6-44e1-af52-f0b83bfc3c48 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:13.796659 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-6ddeb235-f8e6-44e1-af52-f0b83bfc3c48 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:13.797384 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-6ddeb235-f8e6-44e1-af52-f0b83bfc3c48 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:13.797820 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-6ddeb235-f8e6-44e1-af52-f0b83bfc3c48 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:13.799110 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-6ddeb235-f8e6-44e1-af52-f0b83bfc3c48 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:13.799711 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-6ddeb235-f8e6-44e1-af52-f0b83bfc3c48 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:13.800273 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-6ddeb235-f8e6-44e1-af52-f0b83bfc3c48 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:14.048077 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-6ddeb235-f8e6-44e1-af52-f0b83bfc3c48 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:53:14.058870 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-6ddeb235-f8e6-44e1-af52-f0b83bfc3c48 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1522 microversion: 2.1 time: 0.280094 Sep 20 04:53:14.061548 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 82/185] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:13 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:53:15.086754 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-2bf1be9b-7eab-4200-8a03-aca18c07bff6 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:15.087358 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-2bf1be9b-7eab-4200-8a03-aca18c07bff6 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:15.101122 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2bf1be9b-7eab-4200-8a03-aca18c07bff6 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:15.101623 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2bf1be9b-7eab-4200-8a03-aca18c07bff6 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:15.102074 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2bf1be9b-7eab-4200-8a03-aca18c07bff6 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:15.102753 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2bf1be9b-7eab-4200-8a03-aca18c07bff6 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:15.103458 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2bf1be9b-7eab-4200-8a03-aca18c07bff6 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:15.105029 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2bf1be9b-7eab-4200-8a03-aca18c07bff6 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:15.347849 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-2bf1be9b-7eab-4200-8a03-aca18c07bff6 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:53:15.373761 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-2bf1be9b-7eab-4200-8a03-aca18c07bff6 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1522 microversion: 2.1 time: 0.292606 Sep 20 04:53:15.382380 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 104/186] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:15 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1522 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:53:16.415632 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-d085f0d7-8e3c-4182-a750-9640a9af6d81 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:16.419073 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-d085f0d7-8e3c-4182-a750-9640a9af6d81 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:16.432004 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-d085f0d7-8e3c-4182-a750-9640a9af6d81 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:16.433387 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-d085f0d7-8e3c-4182-a750-9640a9af6d81 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:16.437785 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-d085f0d7-8e3c-4182-a750-9640a9af6d81 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:16.439494 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-d085f0d7-8e3c-4182-a750-9640a9af6d81 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:16.439992 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-d085f0d7-8e3c-4182-a750-9640a9af6d81 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:16.440427 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-d085f0d7-8e3c-4182-a750-9640a9af6d81 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:16.665867 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-d085f0d7-8e3c-4182-a750-9640a9af6d81 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:53:16.676273 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-d085f0d7-8e3c-4182-a750-9640a9af6d81 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1522 microversion: 2.1 time: 0.276701 Sep 20 04:53:16.680653 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 83/187] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:16 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:53:17.700891 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-553adbfa-5df6-4bfd-8bed-5e058e5ae266 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:17.701498 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-553adbfa-5df6-4bfd-8bed-5e058e5ae266 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:17.707699 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:17.711074 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-553adbfa-5df6-4bfd-8bed-5e058e5ae266 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:17.711564 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-553adbfa-5df6-4bfd-8bed-5e058e5ae266 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:17.711897 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-553adbfa-5df6-4bfd-8bed-5e058e5ae266 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:17.712586 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-553adbfa-5df6-4bfd-8bed-5e058e5ae266 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:17.713839 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-553adbfa-5df6-4bfd-8bed-5e058e5ae266 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:17.714672 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-553adbfa-5df6-4bfd-8bed-5e058e5ae266 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:17.749474 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:17.907333 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-553adbfa-5df6-4bfd-8bed-5e058e5ae266 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:53:17.918802 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-553adbfa-5df6-4bfd-8bed-5e058e5ae266 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1522 microversion: 2.1 time: 0.222310 Sep 20 04:53:17.919881 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 105/188] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:17 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:53:18.943294 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-11de87b1-6185-42cc-9c43-ac4f40c81ac5 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:18.943901 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-11de87b1-6185-42cc-9c43-ac4f40c81ac5 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:18.950681 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG dbcounter [-] [126814] Writing DB stats nova_api:SELECT=50 {{(pid=126814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:18.952047 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-11de87b1-6185-42cc-9c43-ac4f40c81ac5 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:18.952523 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-11de87b1-6185-42cc-9c43-ac4f40c81ac5 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:18.952980 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-11de87b1-6185-42cc-9c43-ac4f40c81ac5 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:18.953665 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-11de87b1-6185-42cc-9c43-ac4f40c81ac5 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:18.954147 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-11de87b1-6185-42cc-9c43-ac4f40c81ac5 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:18.954507 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-11de87b1-6185-42cc-9c43-ac4f40c81ac5 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:19.217932 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-11de87b1-6185-42cc-9c43-ac4f40c81ac5 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:53:19.229409 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-11de87b1-6185-42cc-9c43-ac4f40c81ac5 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1522 microversion: 2.1 time: 0.289860 Sep 20 04:53:19.230571 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 84/189] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:18 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:53:20.257248 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-a1150323-a727-4117-b85d-a8fc480fd9f9 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:20.257870 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-a1150323-a727-4117-b85d-a8fc480fd9f9 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:20.272847 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a1150323-a727-4117-b85d-a8fc480fd9f9 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:20.273354 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a1150323-a727-4117-b85d-a8fc480fd9f9 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:20.273797 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a1150323-a727-4117-b85d-a8fc480fd9f9 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:20.274504 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a1150323-a727-4117-b85d-a8fc480fd9f9 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:20.274961 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a1150323-a727-4117-b85d-a8fc480fd9f9 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:20.275392 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a1150323-a727-4117-b85d-a8fc480fd9f9 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:20.537547 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-a1150323-a727-4117-b85d-a8fc480fd9f9 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:53:20.551045 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-a1150323-a727-4117-b85d-a8fc480fd9f9 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1522 microversion: 2.1 time: 0.298260 Sep 20 04:53:20.551866 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 106/190] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:20 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:53:21.579606 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-a71158e1-b079-4270-a45c-f85646d0daa0 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:21.580534 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-a71158e1-b079-4270-a45c-f85646d0daa0 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:21.589470 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-a71158e1-b079-4270-a45c-f85646d0daa0 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:21.589956 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-a71158e1-b079-4270-a45c-f85646d0daa0 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:21.590386 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-a71158e1-b079-4270-a45c-f85646d0daa0 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:21.591086 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-a71158e1-b079-4270-a45c-f85646d0daa0 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:21.591702 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-a71158e1-b079-4270-a45c-f85646d0daa0 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:21.592119 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-a71158e1-b079-4270-a45c-f85646d0daa0 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:21.890234 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-a71158e1-b079-4270-a45c-f85646d0daa0 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:53:21.906214 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-a71158e1-b079-4270-a45c-f85646d0daa0 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1522 microversion: 2.1 time: 0.328637 Sep 20 04:53:21.908875 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 85/191] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:21 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1522 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:53:22.936456 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-b4eff260-cdee-4d5f-94a0-e3587a7bc982 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:22.937073 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-b4eff260-cdee-4d5f-94a0-e3587a7bc982 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:22.952064 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b4eff260-cdee-4d5f-94a0-e3587a7bc982 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:22.952350 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b4eff260-cdee-4d5f-94a0-e3587a7bc982 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:22.952821 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b4eff260-cdee-4d5f-94a0-e3587a7bc982 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:22.958405 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b4eff260-cdee-4d5f-94a0-e3587a7bc982 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:22.961448 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b4eff260-cdee-4d5f-94a0-e3587a7bc982 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:22.963918 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b4eff260-cdee-4d5f-94a0-e3587a7bc982 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:23.192132 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-b4eff260-cdee-4d5f-94a0-e3587a7bc982 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:53:23.205865 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-b4eff260-cdee-4d5f-94a0-e3587a7bc982 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1522 microversion: 2.1 time: 0.275867 Sep 20 04:53:23.206449 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 107/192] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:22 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:53:24.229367 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-b9d7d1ee-3433-4b86-a793-7f70e8e357dc tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:24.230046 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-b9d7d1ee-3433-4b86-a793-7f70e8e357dc tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:24.241362 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-b9d7d1ee-3433-4b86-a793-7f70e8e357dc tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:24.241851 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-b9d7d1ee-3433-4b86-a793-7f70e8e357dc tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:24.242287 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-b9d7d1ee-3433-4b86-a793-7f70e8e357dc tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:24.242998 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-b9d7d1ee-3433-4b86-a793-7f70e8e357dc tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:24.243445 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-b9d7d1ee-3433-4b86-a793-7f70e8e357dc tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:24.244317 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-b9d7d1ee-3433-4b86-a793-7f70e8e357dc tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:24.465902 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-b9d7d1ee-3433-4b86-a793-7f70e8e357dc tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:53:24.475160 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-b9d7d1ee-3433-4b86-a793-7f70e8e357dc tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1522 microversion: 2.1 time: 0.249685 Sep 20 04:53:24.476155 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 86/193] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:24 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:53:25.499470 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-5dd8c322-b2df-4b79-9731-15a02b69146a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:25.500096 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-5dd8c322-b2df-4b79-9731-15a02b69146a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:25.508619 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5dd8c322-b2df-4b79-9731-15a02b69146a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:25.510532 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5dd8c322-b2df-4b79-9731-15a02b69146a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:25.513147 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5dd8c322-b2df-4b79-9731-15a02b69146a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:25.514220 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5dd8c322-b2df-4b79-9731-15a02b69146a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:25.514785 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5dd8c322-b2df-4b79-9731-15a02b69146a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:25.515208 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5dd8c322-b2df-4b79-9731-15a02b69146a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:25.741582 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-5dd8c322-b2df-4b79-9731-15a02b69146a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:53:25.756668 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-5dd8c322-b2df-4b79-9731-15a02b69146a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1522 microversion: 2.1 time: 0.261762 Sep 20 04:53:25.757207 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 108/194] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:25 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:53:26.785795 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-4700931d-f02b-4ca5-8461-6049e193ece2 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:26.787207 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-4700931d-f02b-4ca5-8461-6049e193ece2 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:26.803574 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-4700931d-f02b-4ca5-8461-6049e193ece2 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:26.803574 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-4700931d-f02b-4ca5-8461-6049e193ece2 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:26.804023 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-4700931d-f02b-4ca5-8461-6049e193ece2 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:26.804755 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-4700931d-f02b-4ca5-8461-6049e193ece2 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:26.805185 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-4700931d-f02b-4ca5-8461-6049e193ece2 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:26.805687 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-4700931d-f02b-4ca5-8461-6049e193ece2 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:26.988638 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-4700931d-f02b-4ca5-8461-6049e193ece2 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:53:27.002202 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-4700931d-f02b-4ca5-8461-6049e193ece2 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1522 microversion: 2.1 time: 0.221465 Sep 20 04:53:27.004634 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 87/195] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:26 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:53:28.027379 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-a03ddf43-d072-4e7b-9e16-e2c1e6301cd5 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:28.028194 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-a03ddf43-d072-4e7b-9e16-e2c1e6301cd5 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:28.035951 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a03ddf43-d072-4e7b-9e16-e2c1e6301cd5 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:28.037072 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a03ddf43-d072-4e7b-9e16-e2c1e6301cd5 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:28.037528 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a03ddf43-d072-4e7b-9e16-e2c1e6301cd5 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:28.038243 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a03ddf43-d072-4e7b-9e16-e2c1e6301cd5 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:28.038719 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a03ddf43-d072-4e7b-9e16-e2c1e6301cd5 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:28.039136 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a03ddf43-d072-4e7b-9e16-e2c1e6301cd5 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:28.211102 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-a03ddf43-d072-4e7b-9e16-e2c1e6301cd5 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:53:28.222402 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-a03ddf43-d072-4e7b-9e16-e2c1e6301cd5 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1522 microversion: 2.1 time: 0.199068 Sep 20 04:53:28.239408 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 109/196] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:28 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:53:29.246188 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-bb44ef21-4cf8-40d2-9290-ccb2c084b038 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:29.246792 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-bb44ef21-4cf8-40d2-9290-ccb2c084b038 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:29.253699 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-bb44ef21-4cf8-40d2-9290-ccb2c084b038 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:29.254152 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-bb44ef21-4cf8-40d2-9290-ccb2c084b038 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:29.254615 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-bb44ef21-4cf8-40d2-9290-ccb2c084b038 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:29.255945 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-bb44ef21-4cf8-40d2-9290-ccb2c084b038 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:29.256424 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-bb44ef21-4cf8-40d2-9290-ccb2c084b038 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:29.256863 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-bb44ef21-4cf8-40d2-9290-ccb2c084b038 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:29.424333 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-bb44ef21-4cf8-40d2-9290-ccb2c084b038 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:53:29.433987 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-bb44ef21-4cf8-40d2-9290-ccb2c084b038 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1522 microversion: 2.1 time: 0.191877 Sep 20 04:53:29.448676 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 88/197] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:29 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:53:30.457454 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-16766a43-80f1-45ce-b48d-6c696c70253a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:30.458053 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-16766a43-80f1-45ce-b48d-6c696c70253a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:30.464745 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-16766a43-80f1-45ce-b48d-6c696c70253a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:30.465397 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-16766a43-80f1-45ce-b48d-6c696c70253a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:30.465843 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-16766a43-80f1-45ce-b48d-6c696c70253a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:30.466690 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-16766a43-80f1-45ce-b48d-6c696c70253a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:30.467143 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-16766a43-80f1-45ce-b48d-6c696c70253a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:30.467775 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-16766a43-80f1-45ce-b48d-6c696c70253a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:30.649172 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-16766a43-80f1-45ce-b48d-6c696c70253a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:53:30.657768 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-16766a43-80f1-45ce-b48d-6c696c70253a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1502 microversion: 2.1 time: 0.204129 Sep 20 04:53:30.658339 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 110/198] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:30 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1502 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:53:30.681189 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-1f6e86bb-cc38-4d43-9c69-447939770229 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:30.682414 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-1f6e86bb-cc38-4d43-9c69-447939770229 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:30.689070 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-1f6e86bb-cc38-4d43-9c69-447939770229 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:30.689549 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-1f6e86bb-cc38-4d43-9c69-447939770229 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:30.689981 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-1f6e86bb-cc38-4d43-9c69-447939770229 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:30.690673 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-1f6e86bb-cc38-4d43-9c69-447939770229 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:30.691123 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-1f6e86bb-cc38-4d43-9c69-447939770229 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:30.691544 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-1f6e86bb-cc38-4d43-9c69-447939770229 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:30.844810 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-1f6e86bb-cc38-4d43-9c69-447939770229 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:53:30.853656 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-1f6e86bb-cc38-4d43-9c69-447939770229 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2" status: 200 len: 1517 microversion: 2.1 time: 0.177054 Sep 20 04:53:30.854419 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 89/199] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:30 2022] GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 => generated 1517 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:53:34.861982 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-2f82fb93-b247-4f1d-ad86-41533769392e tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:53:34.864742 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-2f82fb93-b247-4f1d-ad86-41533769392e tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:34.873882 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2f82fb93-b247-4f1d-ad86-41533769392e tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:34.874374 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2f82fb93-b247-4f1d-ad86-41533769392e tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:34.874814 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2f82fb93-b247-4f1d-ad86-41533769392e tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:34.875512 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2f82fb93-b247-4f1d-ad86-41533769392e tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:34.876125 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2f82fb93-b247-4f1d-ad86-41533769392e tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:34.876731 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2f82fb93-b247-4f1d-ad86-41533769392e tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:34.903206 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.objects.instance [None req-2f82fb93-b247-4f1d-ad86-41533769392e tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lazy-loading 'flavor' on Instance uuid 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 {{(pid=126813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 04:53:35.066150 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-2f82fb93-b247-4f1d-ad86-41533769392e tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "POST /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2/action" status: 200 len: 32 microversion: 2.1 time: 0.208041 Sep 20 04:53:35.071870 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 111/200] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Sep 20 04:53:34 2022] POST /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2/action => generated 32 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 20 04:53:35.079680 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-7ffb3dcc-0b11-4155-b3fd-104398a5dedf tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:35.081385 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-7ffb3dcc-0b11-4155-b3fd-104398a5dedf tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:35.089674 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-7ffb3dcc-0b11-4155-b3fd-104398a5dedf tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:35.089866 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-7ffb3dcc-0b11-4155-b3fd-104398a5dedf tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:35.091110 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-7ffb3dcc-0b11-4155-b3fd-104398a5dedf tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:35.091784 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-7ffb3dcc-0b11-4155-b3fd-104398a5dedf tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:35.092383 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-7ffb3dcc-0b11-4155-b3fd-104398a5dedf tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:35.092996 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-7ffb3dcc-0b11-4155-b3fd-104398a5dedf tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:35.361771 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-7ffb3dcc-0b11-4155-b3fd-104398a5dedf tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:53:35.365828 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG dbcounter [-] [126814] Writing DB stats nova_cell1:SELECT=88 {{(pid=126814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:35.375948 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-7ffb3dcc-0b11-4155-b3fd-104398a5dedf tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2" status: 200 len: 1523 microversion: 2.1 time: 0.301808 Sep 20 04:53:35.376534 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 90/201] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:35 2022] GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 => generated 1523 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:53:36.400268 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-b69723cc-ee2e-4d88-a0f4-5c0fae5991fb tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:36.401532 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-b69723cc-ee2e-4d88-a0f4-5c0fae5991fb tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:36.414105 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b69723cc-ee2e-4d88-a0f4-5c0fae5991fb tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:36.414603 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b69723cc-ee2e-4d88-a0f4-5c0fae5991fb tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:36.415037 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b69723cc-ee2e-4d88-a0f4-5c0fae5991fb tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:36.415779 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b69723cc-ee2e-4d88-a0f4-5c0fae5991fb tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:36.416225 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b69723cc-ee2e-4d88-a0f4-5c0fae5991fb tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:36.416962 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b69723cc-ee2e-4d88-a0f4-5c0fae5991fb tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:36.591581 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-b69723cc-ee2e-4d88-a0f4-5c0fae5991fb tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:53:36.600810 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-b69723cc-ee2e-4d88-a0f4-5c0fae5991fb tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2" status: 200 len: 1523 microversion: 2.1 time: 0.204971 Sep 20 04:53:36.601381 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 112/202] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:36 2022] GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 => generated 1523 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:53:37.624666 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-e8813037-e6a9-4a44-8aa8-4ba15fab32c1 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:37.625919 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-e8813037-e6a9-4a44-8aa8-4ba15fab32c1 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:37.634606 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-e8813037-e6a9-4a44-8aa8-4ba15fab32c1 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:37.635094 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-e8813037-e6a9-4a44-8aa8-4ba15fab32c1 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:37.635842 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-e8813037-e6a9-4a44-8aa8-4ba15fab32c1 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:37.636572 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-e8813037-e6a9-4a44-8aa8-4ba15fab32c1 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:37.637235 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-e8813037-e6a9-4a44-8aa8-4ba15fab32c1 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:37.637663 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-e8813037-e6a9-4a44-8aa8-4ba15fab32c1 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:37.798833 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-e8813037-e6a9-4a44-8aa8-4ba15fab32c1 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:53:37.820812 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-e8813037-e6a9-4a44-8aa8-4ba15fab32c1 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2" status: 200 len: 1523 microversion: 2.1 time: 0.194807 Sep 20 04:53:37.821753 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 91/203] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:37 2022] GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 => generated 1523 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:53:38.844503 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-466b8a98-7b98-4690-a410-18d4b0dafe3d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:38.845071 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-466b8a98-7b98-4690-a410-18d4b0dafe3d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:38.851872 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-466b8a98-7b98-4690-a410-18d4b0dafe3d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:38.852360 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-466b8a98-7b98-4690-a410-18d4b0dafe3d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:38.852952 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-466b8a98-7b98-4690-a410-18d4b0dafe3d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:38.853650 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-466b8a98-7b98-4690-a410-18d4b0dafe3d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:38.854105 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-466b8a98-7b98-4690-a410-18d4b0dafe3d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:38.854526 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-466b8a98-7b98-4690-a410-18d4b0dafe3d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:39.062438 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-466b8a98-7b98-4690-a410-18d4b0dafe3d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:53:39.077996 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-466b8a98-7b98-4690-a410-18d4b0dafe3d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2" status: 200 len: 1523 microversion: 2.1 time: 0.237508 Sep 20 04:53:39.079487 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 113/204] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:38 2022] GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 => generated 1523 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:53:40.103681 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-ee5cd609-2924-43a3-b927-974195b2a5ab tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:40.104295 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-ee5cd609-2924-43a3-b927-974195b2a5ab tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:40.110956 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-ee5cd609-2924-43a3-b927-974195b2a5ab tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:40.111436 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-ee5cd609-2924-43a3-b927-974195b2a5ab tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:40.111872 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-ee5cd609-2924-43a3-b927-974195b2a5ab tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:40.112744 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-ee5cd609-2924-43a3-b927-974195b2a5ab tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:40.113022 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-ee5cd609-2924-43a3-b927-974195b2a5ab tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:40.113444 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-ee5cd609-2924-43a3-b927-974195b2a5ab tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:40.260790 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-ee5cd609-2924-43a3-b927-974195b2a5ab tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:53:40.268629 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-ee5cd609-2924-43a3-b927-974195b2a5ab tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2" status: 200 len: 1523 microversion: 2.1 time: 0.168715 Sep 20 04:53:40.269194 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 92/205] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:40 2022] GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:53:41.293459 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-75238204-9f91-4df9-b86d-2f2f94d563e8 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:41.294066 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-75238204-9f91-4df9-b86d-2f2f94d563e8 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:41.300390 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-75238204-9f91-4df9-b86d-2f2f94d563e8 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:41.300911 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-75238204-9f91-4df9-b86d-2f2f94d563e8 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:41.301449 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-75238204-9f91-4df9-b86d-2f2f94d563e8 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:41.302669 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-75238204-9f91-4df9-b86d-2f2f94d563e8 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:41.303120 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-75238204-9f91-4df9-b86d-2f2f94d563e8 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:41.303539 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-75238204-9f91-4df9-b86d-2f2f94d563e8 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:41.432980 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-75238204-9f91-4df9-b86d-2f2f94d563e8 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:53:41.440661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-75238204-9f91-4df9-b86d-2f2f94d563e8 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2" status: 200 len: 1523 microversion: 2.1 time: 0.150942 Sep 20 04:53:41.441225 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 114/206] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:41 2022] GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:53:42.463207 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-bdec30c1-082a-4e99-a89e-b07563d793c5 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:42.463812 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-bdec30c1-082a-4e99-a89e-b07563d793c5 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:42.470080 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-bdec30c1-082a-4e99-a89e-b07563d793c5 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:42.470552 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-bdec30c1-082a-4e99-a89e-b07563d793c5 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:42.471012 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-bdec30c1-082a-4e99-a89e-b07563d793c5 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:42.471650 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-bdec30c1-082a-4e99-a89e-b07563d793c5 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:42.472097 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-bdec30c1-082a-4e99-a89e-b07563d793c5 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:42.472509 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-bdec30c1-082a-4e99-a89e-b07563d793c5 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:42.601167 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-bdec30c1-082a-4e99-a89e-b07563d793c5 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:53:42.608843 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-bdec30c1-082a-4e99-a89e-b07563d793c5 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2" status: 200 len: 1523 microversion: 2.1 time: 0.149623 Sep 20 04:53:42.609397 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 93/207] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:42 2022] GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:53:43.632287 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-6913cf47-c702-4738-803b-19a4b70d0343 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:43.633011 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-6913cf47-c702-4738-803b-19a4b70d0343 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:43.639569 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6913cf47-c702-4738-803b-19a4b70d0343 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:43.640058 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6913cf47-c702-4738-803b-19a4b70d0343 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:43.640494 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6913cf47-c702-4738-803b-19a4b70d0343 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:43.641213 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6913cf47-c702-4738-803b-19a4b70d0343 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:43.641661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6913cf47-c702-4738-803b-19a4b70d0343 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:43.642086 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6913cf47-c702-4738-803b-19a4b70d0343 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:43.786338 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-6913cf47-c702-4738-803b-19a4b70d0343 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:53:43.797592 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-6913cf47-c702-4738-803b-19a4b70d0343 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2" status: 200 len: 1523 microversion: 2.1 time: 0.168979 Sep 20 04:53:43.798160 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 115/208] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:43 2022] GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:53:44.821509 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-fe38c3fe-432c-4fa5-8ac6-f07d33dcf051 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:44.822113 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-fe38c3fe-432c-4fa5-8ac6-f07d33dcf051 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:44.828254 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-fe38c3fe-432c-4fa5-8ac6-f07d33dcf051 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:44.828769 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-fe38c3fe-432c-4fa5-8ac6-f07d33dcf051 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:44.829199 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-fe38c3fe-432c-4fa5-8ac6-f07d33dcf051 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:44.829904 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-fe38c3fe-432c-4fa5-8ac6-f07d33dcf051 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:44.830406 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-fe38c3fe-432c-4fa5-8ac6-f07d33dcf051 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:44.831063 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-fe38c3fe-432c-4fa5-8ac6-f07d33dcf051 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:44.965970 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-fe38c3fe-432c-4fa5-8ac6-f07d33dcf051 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:53:44.975093 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-fe38c3fe-432c-4fa5-8ac6-f07d33dcf051 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2" status: 200 len: 1523 microversion: 2.1 time: 0.158140 Sep 20 04:53:44.975894 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 94/209] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:44 2022] GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:53:45.999981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-9cccbd3a-1236-4521-aec0-554ba4234cac tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:46.000811 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-9cccbd3a-1236-4521-aec0-554ba4234cac tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:46.009587 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9cccbd3a-1236-4521-aec0-554ba4234cac tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:46.013401 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9cccbd3a-1236-4521-aec0-554ba4234cac tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:46.015128 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9cccbd3a-1236-4521-aec0-554ba4234cac tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:46.017148 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9cccbd3a-1236-4521-aec0-554ba4234cac tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:46.017958 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9cccbd3a-1236-4521-aec0-554ba4234cac tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:46.018771 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9cccbd3a-1236-4521-aec0-554ba4234cac tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:46.174711 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-9cccbd3a-1236-4521-aec0-554ba4234cac tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:53:46.184777 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-9cccbd3a-1236-4521-aec0-554ba4234cac tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2" status: 200 len: 1523 microversion: 2.1 time: 0.189311 Sep 20 04:53:46.185746 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 116/210] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:45 2022] GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 => generated 1523 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:53:47.207467 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-70d6437a-0515-43c7-aedc-bfa6f70cf1ee tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:47.208292 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-70d6437a-0515-43c7-aedc-bfa6f70cf1ee tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:47.215878 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-70d6437a-0515-43c7-aedc-bfa6f70cf1ee tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:47.216365 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-70d6437a-0515-43c7-aedc-bfa6f70cf1ee tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:47.216840 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-70d6437a-0515-43c7-aedc-bfa6f70cf1ee tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:47.217534 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-70d6437a-0515-43c7-aedc-bfa6f70cf1ee tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:47.218155 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-70d6437a-0515-43c7-aedc-bfa6f70cf1ee tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:47.218587 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-70d6437a-0515-43c7-aedc-bfa6f70cf1ee tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:47.366042 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-70d6437a-0515-43c7-aedc-bfa6f70cf1ee tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:53:47.375631 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-70d6437a-0515-43c7-aedc-bfa6f70cf1ee tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2" status: 200 len: 1523 microversion: 2.1 time: 0.172231 Sep 20 04:53:47.376210 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 95/211] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:47 2022] GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:53:48.401735 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-24b80b88-2374-4aeb-b95f-5925c4c46404 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:48.402380 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-24b80b88-2374-4aeb-b95f-5925c4c46404 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:48.404379 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_api:SELECT=24 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:48.409756 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-24b80b88-2374-4aeb-b95f-5925c4c46404 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:48.410242 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-24b80b88-2374-4aeb-b95f-5925c4c46404 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:48.410682 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-24b80b88-2374-4aeb-b95f-5925c4c46404 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:48.411380 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-24b80b88-2374-4aeb-b95f-5925c4c46404 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:48.411835 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-24b80b88-2374-4aeb-b95f-5925c4c46404 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:48.412854 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-24b80b88-2374-4aeb-b95f-5925c4c46404 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:48.415675 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:48.558743 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-24b80b88-2374-4aeb-b95f-5925c4c46404 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:53:48.566495 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-24b80b88-2374-4aeb-b95f-5925c4c46404 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2" status: 200 len: 1523 microversion: 2.1 time: 0.168600 Sep 20 04:53:48.567066 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 117/212] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:48 2022] GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:53:49.589723 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-98bb53b0-c6b9-429e-8a38-845ff8a670fc tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:49.590330 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-98bb53b0-c6b9-429e-8a38-845ff8a670fc tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:49.592676 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG dbcounter [-] [126814] Writing DB stats nova_api:SELECT=24 {{(pid=126814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:49.598438 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-98bb53b0-c6b9-429e-8a38-845ff8a670fc tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:49.599222 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-98bb53b0-c6b9-429e-8a38-845ff8a670fc tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:49.599699 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-98bb53b0-c6b9-429e-8a38-845ff8a670fc tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:49.600629 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-98bb53b0-c6b9-429e-8a38-845ff8a670fc tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:49.601082 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-98bb53b0-c6b9-429e-8a38-845ff8a670fc tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:49.601505 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-98bb53b0-c6b9-429e-8a38-845ff8a670fc tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:49.735029 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-98bb53b0-c6b9-429e-8a38-845ff8a670fc tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:53:49.743223 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-98bb53b0-c6b9-429e-8a38-845ff8a670fc tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2" status: 200 len: 1523 microversion: 2.1 time: 0.157299 Sep 20 04:53:49.743791 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 96/213] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:49 2022] GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:53:50.767521 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-82b9de71-9de9-4a76-bac1-85ba693c43e7 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:50.768160 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-82b9de71-9de9-4a76-bac1-85ba693c43e7 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:50.775040 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-82b9de71-9de9-4a76-bac1-85ba693c43e7 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:50.775518 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-82b9de71-9de9-4a76-bac1-85ba693c43e7 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:50.775953 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-82b9de71-9de9-4a76-bac1-85ba693c43e7 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:50.776660 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-82b9de71-9de9-4a76-bac1-85ba693c43e7 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:50.777118 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-82b9de71-9de9-4a76-bac1-85ba693c43e7 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:50.777891 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-82b9de71-9de9-4a76-bac1-85ba693c43e7 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:50.917607 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-82b9de71-9de9-4a76-bac1-85ba693c43e7 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:53:50.926103 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-82b9de71-9de9-4a76-bac1-85ba693c43e7 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2" status: 200 len: 1523 microversion: 2.1 time: 0.162503 Sep 20 04:53:50.926820 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 118/214] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:50 2022] GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:53:51.948964 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-61ea118d-9528-4a74-80c9-eaa73c22f260 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:51.949563 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-61ea118d-9528-4a74-80c9-eaa73c22f260 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:51.955671 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-61ea118d-9528-4a74-80c9-eaa73c22f260 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:51.956183 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-61ea118d-9528-4a74-80c9-eaa73c22f260 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:51.956679 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-61ea118d-9528-4a74-80c9-eaa73c22f260 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:51.957364 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-61ea118d-9528-4a74-80c9-eaa73c22f260 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:51.957934 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-61ea118d-9528-4a74-80c9-eaa73c22f260 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:51.958425 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-61ea118d-9528-4a74-80c9-eaa73c22f260 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:52.103522 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-61ea118d-9528-4a74-80c9-eaa73c22f260 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:53:52.115105 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-61ea118d-9528-4a74-80c9-eaa73c22f260 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2" status: 200 len: 1523 microversion: 2.1 time: 0.169897 Sep 20 04:53:52.115680 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 97/215] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:51 2022] GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:53:53.141356 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-10d74a56-7860-4b11-85c4-29da1f64a306 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:53.142807 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-10d74a56-7860-4b11-85c4-29da1f64a306 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:53.152429 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-10d74a56-7860-4b11-85c4-29da1f64a306 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:53.153041 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-10d74a56-7860-4b11-85c4-29da1f64a306 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:53.153792 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-10d74a56-7860-4b11-85c4-29da1f64a306 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:53.154526 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-10d74a56-7860-4b11-85c4-29da1f64a306 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:53.155139 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-10d74a56-7860-4b11-85c4-29da1f64a306 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:53.155680 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-10d74a56-7860-4b11-85c4-29da1f64a306 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:53.368020 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-10d74a56-7860-4b11-85c4-29da1f64a306 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:53:53.377688 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-10d74a56-7860-4b11-85c4-29da1f64a306 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2" status: 200 len: 1523 microversion: 2.1 time: 0.240684 Sep 20 04:53:53.378514 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 119/216] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:53 2022] GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 => generated 1523 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:53:53.897476 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-319650a2-8d85-4729-aff7-df232be3a512 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:53.899471 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-319650a2-8d85-4729-aff7-df232be3a512 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:53.918955 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-319650a2-8d85-4729-aff7-df232be3a512 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:53.919673 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-319650a2-8d85-4729-aff7-df232be3a512 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:53.920276 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-319650a2-8d85-4729-aff7-df232be3a512 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:53.921183 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-319650a2-8d85-4729-aff7-df232be3a512 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:53.921776 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-319650a2-8d85-4729-aff7-df232be3a512 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:53.922355 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-319650a2-8d85-4729-aff7-df232be3a512 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:53.947681 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-319650a2-8d85-4729-aff7-df232be3a512 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab/ips" status: 200 len: 149 microversion: 2.1 time: 0.054280 Sep 20 04:53:53.948253 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 98/217] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Sep 20 04:53:53 2022] GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab/ips => generated 149 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:53:54.405040 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-4e248b44-2411-4e23-bdcf-a8194bf3da72 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:54.406274 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-4e248b44-2411-4e23-bdcf-a8194bf3da72 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:54.413961 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4e248b44-2411-4e23-bdcf-a8194bf3da72 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:54.414728 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4e248b44-2411-4e23-bdcf-a8194bf3da72 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:54.415429 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4e248b44-2411-4e23-bdcf-a8194bf3da72 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:54.416219 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4e248b44-2411-4e23-bdcf-a8194bf3da72 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:54.416928 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4e248b44-2411-4e23-bdcf-a8194bf3da72 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:54.417566 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4e248b44-2411-4e23-bdcf-a8194bf3da72 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:54.589660 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-4e248b44-2411-4e23-bdcf-a8194bf3da72 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:53:54.598194 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-4e248b44-2411-4e23-bdcf-a8194bf3da72 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2" status: 200 len: 1523 microversion: 2.1 time: 0.198571 Sep 20 04:53:54.598910 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 120/218] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:54 2022] GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 => generated 1523 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:53:55.622150 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-36d9b786-582f-46f4-9cb0-e8d1bb68d16a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:55.622778 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-36d9b786-582f-46f4-9cb0-e8d1bb68d16a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:55.629397 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-36d9b786-582f-46f4-9cb0-e8d1bb68d16a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:55.629876 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-36d9b786-582f-46f4-9cb0-e8d1bb68d16a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:55.630358 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-36d9b786-582f-46f4-9cb0-e8d1bb68d16a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:55.631563 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-36d9b786-582f-46f4-9cb0-e8d1bb68d16a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:55.632008 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-36d9b786-582f-46f4-9cb0-e8d1bb68d16a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:55.632429 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-36d9b786-582f-46f4-9cb0-e8d1bb68d16a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:55.764928 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-36d9b786-582f-46f4-9cb0-e8d1bb68d16a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:53:55.773330 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-36d9b786-582f-46f4-9cb0-e8d1bb68d16a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2" status: 200 len: 1523 microversion: 2.1 time: 0.155009 Sep 20 04:53:55.774071 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 99/219] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:55 2022] GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:53:56.456264 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-97d98664-76a7-4c62-b540-66aff459b309 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce7be707-6e56-4737-bec2-4755c6c8c374"}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:53:56.459307 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-97d98664-76a7-4c62-b540-66aff459b309 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:56.465350 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-97d98664-76a7-4c62-b540-66aff459b309 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:56.465840 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-97d98664-76a7-4c62-b540-66aff459b309 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:56.466275 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-97d98664-76a7-4c62-b540-66aff459b309 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:56.466975 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-97d98664-76a7-4c62-b540-66aff459b309 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:56.467430 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-97d98664-76a7-4c62-b540-66aff459b309 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:56.467847 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-97d98664-76a7-4c62-b540-66aff459b309 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:56.796220 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-56df9f3f-a8ce-44b2-b7b5-ff12c0d9159e tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:56.797121 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-56df9f3f-a8ce-44b2-b7b5-ff12c0d9159e tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:56.806297 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-56df9f3f-a8ce-44b2-b7b5-ff12c0d9159e tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:56.806927 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-56df9f3f-a8ce-44b2-b7b5-ff12c0d9159e tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:56.807759 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-56df9f3f-a8ce-44b2-b7b5-ff12c0d9159e tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:56.809007 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-56df9f3f-a8ce-44b2-b7b5-ff12c0d9159e tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:56.809557 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-56df9f3f-a8ce-44b2-b7b5-ff12c0d9159e tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:56.810038 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-56df9f3f-a8ce-44b2-b7b5-ff12c0d9159e tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:57.000008 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-56df9f3f-a8ce-44b2-b7b5-ff12c0d9159e tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:53:57.007002 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-97d98664-76a7-4c62-b540-66aff459b309 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "POST /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.554241 Sep 20 04:53:57.008204 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 121/220] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Sep 20 04:53:56 2022] POST /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab/os-volume_attachments => generated 194 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:53:57.010488 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-56df9f3f-a8ce-44b2-b7b5-ff12c0d9159e tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2" status: 200 len: 1523 microversion: 2.1 time: 0.218326 Sep 20 04:53:57.011054 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 100/221] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:56 2022] GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 => generated 1523 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:53:58.037056 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-04f95f7b-8b34-4aee-98b4-936a64c0c07f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:58.038388 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-04f95f7b-8b34-4aee-98b4-936a64c0c07f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:58.045618 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-04f95f7b-8b34-4aee-98b4-936a64c0c07f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:58.046097 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-04f95f7b-8b34-4aee-98b4-936a64c0c07f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:58.046533 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-04f95f7b-8b34-4aee-98b4-936a64c0c07f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:58.047217 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-04f95f7b-8b34-4aee-98b4-936a64c0c07f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:58.047668 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-04f95f7b-8b34-4aee-98b4-936a64c0c07f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:58.048092 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-04f95f7b-8b34-4aee-98b4-936a64c0c07f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:58.184830 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-04f95f7b-8b34-4aee-98b4-936a64c0c07f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:53:58.192484 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-04f95f7b-8b34-4aee-98b4-936a64c0c07f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2" status: 200 len: 1523 microversion: 2.1 time: 0.160240 Sep 20 04:53:58.193589 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 122/222] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:58 2022] GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:53:59.215303 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-65a02202-fe04-4b94-a623-74176d122998 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:53:59.215909 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-65a02202-fe04-4b94-a623-74176d122998 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:53:59.222495 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-65a02202-fe04-4b94-a623-74176d122998 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:59.222967 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-65a02202-fe04-4b94-a623-74176d122998 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:59.223393 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-65a02202-fe04-4b94-a623-74176d122998 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:59.224093 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-65a02202-fe04-4b94-a623-74176d122998 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:53:59.224534 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-65a02202-fe04-4b94-a623-74176d122998 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:53:59.224987 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-65a02202-fe04-4b94-a623-74176d122998 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:53:59.488115 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-65a02202-fe04-4b94-a623-74176d122998 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:53:59.495867 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-65a02202-fe04-4b94-a623-74176d122998 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2" status: 200 len: 1523 microversion: 2.1 time: 0.284313 Sep 20 04:53:59.496417 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 101/223] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:53:59 2022] GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 => generated 1523 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:54:00.520508 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-3b79f9f0-12e8-4d79-86c7-526f1ebb911a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:00.521773 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-3b79f9f0-12e8-4d79-86c7-526f1ebb911a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:00.528129 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3b79f9f0-12e8-4d79-86c7-526f1ebb911a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:00.528615 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3b79f9f0-12e8-4d79-86c7-526f1ebb911a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:00.529063 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3b79f9f0-12e8-4d79-86c7-526f1ebb911a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:00.529736 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3b79f9f0-12e8-4d79-86c7-526f1ebb911a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:00.530182 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3b79f9f0-12e8-4d79-86c7-526f1ebb911a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:00.530600 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3b79f9f0-12e8-4d79-86c7-526f1ebb911a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:00.664593 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-3b79f9f0-12e8-4d79-86c7-526f1ebb911a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:00.673327 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-3b79f9f0-12e8-4d79-86c7-526f1ebb911a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2" status: 200 len: 1523 microversion: 2.1 time: 0.156869 Sep 20 04:54:00.673900 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 123/224] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:00 2022] GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:54:01.698175 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-4ef6f75f-9c40-4dd9-845b-fda830cbd0cc tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:01.699064 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-4ef6f75f-9c40-4dd9-845b-fda830cbd0cc tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:01.709166 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-4ef6f75f-9c40-4dd9-845b-fda830cbd0cc tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:01.709735 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-4ef6f75f-9c40-4dd9-845b-fda830cbd0cc tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:01.710566 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-4ef6f75f-9c40-4dd9-845b-fda830cbd0cc tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:01.711415 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-4ef6f75f-9c40-4dd9-845b-fda830cbd0cc tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:01.712372 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-4ef6f75f-9c40-4dd9-845b-fda830cbd0cc tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:01.713329 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-4ef6f75f-9c40-4dd9-845b-fda830cbd0cc tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:01.872038 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-4ef6f75f-9c40-4dd9-845b-fda830cbd0cc tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:01.880169 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-4ef6f75f-9c40-4dd9-845b-fda830cbd0cc tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2" status: 200 len: 1523 microversion: 2.1 time: 0.188484 Sep 20 04:54:01.881339 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 102/225] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:01 2022] GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 => generated 1523 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:54:02.904275 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-f4f4ff32-b718-4d73-92d8-ec7cbb4b5e70 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:02.905026 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-f4f4ff32-b718-4d73-92d8-ec7cbb4b5e70 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:02.912171 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f4f4ff32-b718-4d73-92d8-ec7cbb4b5e70 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:02.912683 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f4f4ff32-b718-4d73-92d8-ec7cbb4b5e70 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:02.913117 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f4f4ff32-b718-4d73-92d8-ec7cbb4b5e70 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:02.913828 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f4f4ff32-b718-4d73-92d8-ec7cbb4b5e70 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:02.914274 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f4f4ff32-b718-4d73-92d8-ec7cbb4b5e70 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:02.914694 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f4f4ff32-b718-4d73-92d8-ec7cbb4b5e70 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:03.057397 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-f4f4ff32-b718-4d73-92d8-ec7cbb4b5e70 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:03.065157 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-f4f4ff32-b718-4d73-92d8-ec7cbb4b5e70 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2" status: 200 len: 1523 microversion: 2.1 time: 0.164812 Sep 20 04:54:03.065724 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 124/226] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:02 2022] GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:54:04.087785 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-f610b273-1705-4b58-a6ba-8b413af8cffd tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:04.088413 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-f610b273-1705-4b58-a6ba-8b413af8cffd tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:04.096045 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-f610b273-1705-4b58-a6ba-8b413af8cffd tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:04.097096 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-f610b273-1705-4b58-a6ba-8b413af8cffd tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:04.098701 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-f610b273-1705-4b58-a6ba-8b413af8cffd tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:04.100881 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-f610b273-1705-4b58-a6ba-8b413af8cffd tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:04.101596 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-f610b273-1705-4b58-a6ba-8b413af8cffd tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:04.102789 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-f610b273-1705-4b58-a6ba-8b413af8cffd tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:04.375224 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-f610b273-1705-4b58-a6ba-8b413af8cffd tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:04.391170 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-f610b273-1705-4b58-a6ba-8b413af8cffd tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2" status: 200 len: 1523 microversion: 2.1 time: 0.307033 Sep 20 04:54:04.391961 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 103/227] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:04 2022] GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 => generated 1523 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:54:05.414937 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-597ce779-c829-458b-abe1-172af7f78de0 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:05.416244 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-597ce779-c829-458b-abe1-172af7f78de0 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:05.427941 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-597ce779-c829-458b-abe1-172af7f78de0 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:05.428881 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-597ce779-c829-458b-abe1-172af7f78de0 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:05.429553 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-597ce779-c829-458b-abe1-172af7f78de0 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:05.430683 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-597ce779-c829-458b-abe1-172af7f78de0 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:05.431365 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-597ce779-c829-458b-abe1-172af7f78de0 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:05.432019 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-597ce779-c829-458b-abe1-172af7f78de0 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:05.764015 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-597ce779-c829-458b-abe1-172af7f78de0 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:05.773682 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-597ce779-c829-458b-abe1-172af7f78de0 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2" status: 200 len: 1503 microversion: 2.1 time: 0.362425 Sep 20 04:54:05.789845 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 125/228] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:05 2022] GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 => generated 1503 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:54:05.805181 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-ed4524e0-edce-46ac-b1dc-625f35546eb3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3e1d568a-8bf0-4644-9587-0a1eaef698fa"}} {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:54:05.811125 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-ed4524e0-edce-46ac-b1dc-625f35546eb3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:05.823451 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-ed4524e0-edce-46ac-b1dc-625f35546eb3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:05.824179 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-ed4524e0-edce-46ac-b1dc-625f35546eb3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:05.824809 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-ed4524e0-edce-46ac-b1dc-625f35546eb3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:05.825684 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-ed4524e0-edce-46ac-b1dc-625f35546eb3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:05.826135 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-ed4524e0-edce-46ac-b1dc-625f35546eb3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:05.826561 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-ed4524e0-edce-46ac-b1dc-625f35546eb3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:05.830536 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG dbcounter [-] [126814] Writing DB stats nova_cell1:SELECT=78 {{(pid=126814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:54:05.857305 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.wsgi [None req-ed4524e0-edce-46ac-b1dc-625f35546eb3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] HTTP exception thrown: Cannot 'attach_volume' instance 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 while it is in vm_state rescued Sep 20 04:54:05.859230 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-ed4524e0-edce-46ac-b1dc-625f35546eb3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Request method failure captured: Sep 20 04:54:05.859230 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: request: POST /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2/os-volume_attachments HTTP/1.1 Sep 20 04:54:05.859230 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: Accept: application/json Sep 20 04:54:05.859230 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: Accept-Encoding: identity Sep 20 04:54:05.859230 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: Connection: close Sep 20 04:54:05.859230 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: Content-Length: 74 Sep 20 04:54:05.859230 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: Content-Type: application/json Sep 20 04:54:05.859230 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: Host: 10.222.0.27 Sep 20 04:54:05.859230 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: Openstack-System-Scope: None Sep 20 04:54:05.859230 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: User-Agent: python-urllib3/1.26.12 Sep 20 04:54:05.859230 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Auth-Token: gAAAAABjKUbuqmu710n-3SCVM36yM7K-f797gToLzqjsDE8VJysUBrvG5j-mQzogHDlEQu9N838xq1zWP21_6m2gF-Ihax1sPUYdHwZXOTHQerCv9C5MDRbeGOwZhkLdVG9uye1-Ii1JZSsdS5iGMvHtRw8Q9ofnz0LEtfTZ8xxH8stYtJrOnkg Sep 20 04:54:05.859230 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Domain-Id: None Sep 20 04:54:05.859230 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Domain-Name: None Sep 20 04:54:05.859230 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Identity-Status: Confirmed Sep 20 04:54:05.859230 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Is-Admin-Project: True Sep 20 04:54:05.859230 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Project-Domain-Id: default Sep 20 04:54:05.859230 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Project-Domain-Name: Default Sep 20 04:54:05.859230 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Project-Id: 5f0a24f6f6994f45bd314d3009b0a572 Sep 20 04:54:05.859230 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-447939399 Sep 20 04:54:05.859230 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Role: reader,member Sep 20 04:54:05.859230 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Roles: reader,member Sep 20 04:54:05.860577 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5f0a24f6f6994f45bd314d3009b0a572"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5f0a24f6f6994f45bd314d3009b0a572"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5f0a24f6f6994f45bd314d3009b0a572", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5f0a24f6f6994f45bd314d3009b0a572"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 04:54:05.860577 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Tenant: tempest-ServerRescueNegativeTestJSON-447939399 Sep 20 04:54:05.860577 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Tenant-Id: 5f0a24f6f6994f45bd314d3009b0a572 Sep 20 04:54:05.860577 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-447939399 Sep 20 04:54:05.860577 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-User: tempest-ServerRescueNegativeTestJSON-447939399-project Sep 20 04:54:05.860577 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-User-Domain-Id: default Sep 20 04:54:05.860577 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-User-Domain-Name: Default Sep 20 04:54:05.860577 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-User-Id: 49f80b68650940e8850cbd4f84a49ef4 Sep 20 04:54:05.860577 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: X-User-Name: tempest-ServerRescueNegativeTestJSON-447939399-project Sep 20 04:54:05.860577 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: Sep 20 04:54:05.860577 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: {"volumeAttachment": {"volumeId": "3e1d568a-8bf0-4644-9587-0a1eaef698fa"}} Sep 20 04:54:05.860577 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: method: > Sep 20 04:54:05.862163 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: exception: Cannot 'attach_volume' instance 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 while it is in vm_state rescued Sep 20 04:54:05.862163 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: action_args: {'server_id': '208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2', 'body': {'volumeAttachment': {'volumeId': '3e1d568a-8bf0-4644-9587-0a1eaef698fa'}}} Sep 20 04:54:05.862163 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 04:54:05.862163 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:54:05.862163 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 20 04:54:05.862163 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 20 04:54:05.862163 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 20 04:54:05.862163 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 20 04:54:05.862163 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 20 04:54:05.862163 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 20 04:54:05.862163 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 20 04:54:05.862163 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi Sep 20 04:54:05.862163 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:54:05.862163 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi Sep 20 04:54:05.862163 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:54:05.862163 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:54:05.862163 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:54:05.862163 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 04:54:05.862163 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 04:54:05.863680 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 04:54:05.863680 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 04:54:05.863680 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 20 04:54:05.863680 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 20 04:54:05.863680 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 20 04:54:05.863680 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 20 04:54:05.863680 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 20 04:54:05.863680 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 20 04:54:05.863680 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 20 04:54:05.863680 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 20 04:54:05.863680 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 20 04:54:05.863680 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 20 04:54:05.863680 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 while it is in vm_state rescued Sep 20 04:54:05.863680 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi Sep 20 04:54:05.863680 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:54:05.863680 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi Sep 20 04:54:05.863680 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:54:05.863680 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:54:05.863680 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:54:05.865798 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 04:54:05.865798 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 04:54:05.865798 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 while it is in vm_state rescued Sep 20 04:54:05.865798 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack.wsgi Sep 20 04:54:05.865798 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-ed4524e0-edce-46ac-b1dc-625f35546eb3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Returning 409 to user: Cannot 'attach_volume' instance 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 while it is in vm_state rescued {{(pid=126814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 04:54:05.865798 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-ed4524e0-edce-46ac-b1dc-625f35546eb3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "POST /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.066086 Sep 20 04:54:05.865798 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 104/229] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Sep 20 04:54:05 2022] POST /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2/os-volume_attachments => generated 152 bytes in 70 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 20 04:54:05.874972 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-d9ef76e7-df01-43c0-9b61-803ec637bb28 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:54:05.875505 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-d9ef76e7-df01-43c0-9b61-803ec637bb28 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:05.881833 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d9ef76e7-df01-43c0-9b61-803ec637bb28 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:05.882319 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d9ef76e7-df01-43c0-9b61-803ec637bb28 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:05.882767 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d9ef76e7-df01-43c0-9b61-803ec637bb28 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:05.883596 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d9ef76e7-df01-43c0-9b61-803ec637bb28 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:05.884049 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d9ef76e7-df01-43c0-9b61-803ec637bb28 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:05.884676 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d9ef76e7-df01-43c0-9b61-803ec637bb28 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:05.980027 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-d9ef76e7-df01-43c0-9b61-803ec637bb28 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "POST /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2/action" status: 202 len: 0 microversion: 2.1 time: 0.107739 Sep 20 04:54:05.984247 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 126/230] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Sep 20 04:54:05 2022] POST /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 20 04:54:05.991764 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-62cbc8db-6acc-4ac7-a56f-13f90004ba9c tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:05.992648 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-62cbc8db-6acc-4ac7-a56f-13f90004ba9c tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:06.003791 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-62cbc8db-6acc-4ac7-a56f-13f90004ba9c tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:06.004672 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-62cbc8db-6acc-4ac7-a56f-13f90004ba9c tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:06.005319 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-62cbc8db-6acc-4ac7-a56f-13f90004ba9c tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:06.006211 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-62cbc8db-6acc-4ac7-a56f-13f90004ba9c tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:06.006832 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-62cbc8db-6acc-4ac7-a56f-13f90004ba9c tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:06.008300 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-62cbc8db-6acc-4ac7-a56f-13f90004ba9c tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:06.213453 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-62cbc8db-6acc-4ac7-a56f-13f90004ba9c tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:06.223558 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-62cbc8db-6acc-4ac7-a56f-13f90004ba9c tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2" status: 200 len: 1511 microversion: 2.1 time: 0.237948 Sep 20 04:54:06.224798 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 105/231] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:05 2022] GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 => generated 1511 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:54:07.246950 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-b247b949-5fda-4cec-a14a-8c19a284389d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:07.247656 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-b247b949-5fda-4cec-a14a-8c19a284389d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:07.254072 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b247b949-5fda-4cec-a14a-8c19a284389d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:07.254556 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b247b949-5fda-4cec-a14a-8c19a284389d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:07.255512 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b247b949-5fda-4cec-a14a-8c19a284389d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:07.256206 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b247b949-5fda-4cec-a14a-8c19a284389d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:07.256678 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b247b949-5fda-4cec-a14a-8c19a284389d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:07.257107 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b247b949-5fda-4cec-a14a-8c19a284389d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:07.518225 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-b247b949-5fda-4cec-a14a-8c19a284389d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:07.529099 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-b247b949-5fda-4cec-a14a-8c19a284389d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2" status: 200 len: 1511 microversion: 2.1 time: 0.286519 Sep 20 04:54:07.529866 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 127/232] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:07 2022] GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 => generated 1511 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:54:08.553623 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-d08ca771-a548-41bd-b7ac-5030d274c32c tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:08.554232 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-d08ca771-a548-41bd-b7ac-5030d274c32c tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:08.568994 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-d08ca771-a548-41bd-b7ac-5030d274c32c tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:08.569705 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-d08ca771-a548-41bd-b7ac-5030d274c32c tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:08.570299 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-d08ca771-a548-41bd-b7ac-5030d274c32c tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:08.571188 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-d08ca771-a548-41bd-b7ac-5030d274c32c tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:08.571791 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-d08ca771-a548-41bd-b7ac-5030d274c32c tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:08.572366 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-d08ca771-a548-41bd-b7ac-5030d274c32c tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:08.850515 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-d08ca771-a548-41bd-b7ac-5030d274c32c tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:08.860439 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-d08ca771-a548-41bd-b7ac-5030d274c32c tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2" status: 200 len: 1511 microversion: 2.1 time: 0.311186 Sep 20 04:54:08.864892 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 106/233] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:08 2022] GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 => generated 1511 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:54:09.896334 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-57c031ef-0795-4418-b859-1f7835675d7d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:09.896988 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-57c031ef-0795-4418-b859-1f7835675d7d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:09.908247 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-57c031ef-0795-4418-b859-1f7835675d7d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:09.908770 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-57c031ef-0795-4418-b859-1f7835675d7d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:09.909208 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-57c031ef-0795-4418-b859-1f7835675d7d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:09.913610 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-57c031ef-0795-4418-b859-1f7835675d7d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:09.914090 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-57c031ef-0795-4418-b859-1f7835675d7d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:09.914526 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-57c031ef-0795-4418-b859-1f7835675d7d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:10.315488 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-57c031ef-0795-4418-b859-1f7835675d7d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:10.325913 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-57c031ef-0795-4418-b859-1f7835675d7d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2" status: 200 len: 1511 microversion: 2.1 time: 0.434992 Sep 20 04:54:10.326499 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 128/234] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:09 2022] GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 => generated 1511 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:54:11.349255 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-27d6b71b-05bf-4c9b-92fb-fc725472d1b9 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:11.349929 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-27d6b71b-05bf-4c9b-92fb-fc725472d1b9 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:11.368806 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-27d6b71b-05bf-4c9b-92fb-fc725472d1b9 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:11.371694 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-27d6b71b-05bf-4c9b-92fb-fc725472d1b9 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:11.373960 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-27d6b71b-05bf-4c9b-92fb-fc725472d1b9 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:11.376370 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-27d6b71b-05bf-4c9b-92fb-fc725472d1b9 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:11.376903 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-27d6b71b-05bf-4c9b-92fb-fc725472d1b9 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:11.377337 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-27d6b71b-05bf-4c9b-92fb-fc725472d1b9 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:11.425012 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-6d3e6573-0441-4b8b-9138-26bfcf89b1d0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Action: 'create', calling method: .version_select at 0x7f2e4a71dd30>, body: {"keypair": {"name": "tempest-keypair-1653829936", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8ugOgdlqOPdM+V1fccp+ftKXB+0iikk0IvcuOS7h2zW0NhtgQJD5incWIQJZsGHNNCinUd4putEqvJB1qs11T68Jazj7lLwfjN96T+ou32N1Mh7Ta0gjVF1MOj15NC3g=="}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:54:11.477818 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-6d3e6573-0441-4b8b-9138-26bfcf89b1d0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Getting quotas for project 4f0f0b8842ae496292c27a6ee1350d32. Resources: {'key_pairs'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 04:54:11.496096 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-6d3e6573-0441-4b8b-9138-26bfcf89b1d0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Getting quotas for user c93f22104a7b4a7caf0cc8b7180ffc55 and project 4f0f0b8842ae496292c27a6ee1350d32. Resources: {'key_pairs'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 04:54:11.562580 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-6d3e6573-0441-4b8b-9138-26bfcf89b1d0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.141321 Sep 20 04:54:11.563083 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 129/235] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Sep 20 04:54:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 04:54:11.726502 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-27d6b71b-05bf-4c9b-92fb-fc725472d1b9 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:11.741754 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-27d6b71b-05bf-4c9b-92fb-fc725472d1b9 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2" status: 200 len: 1511 microversion: 2.1 time: 0.396259 Sep 20 04:54:11.745292 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 107/236] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:11 2022] GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 => generated 1511 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:54:12.772945 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-80488b6b-3826-42bf-95bc-19806045eddc tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:12.773701 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-80488b6b-3826-42bf-95bc-19806045eddc tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:12.819270 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-80488b6b-3826-42bf-95bc-19806045eddc tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:12.824186 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-80488b6b-3826-42bf-95bc-19806045eddc tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:12.826154 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-80488b6b-3826-42bf-95bc-19806045eddc tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:12.829372 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-80488b6b-3826-42bf-95bc-19806045eddc tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:12.830136 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-80488b6b-3826-42bf-95bc-19806045eddc tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:12.832114 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-80488b6b-3826-42bf-95bc-19806045eddc tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:13.273776 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-80488b6b-3826-42bf-95bc-19806045eddc tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:13.293868 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-80488b6b-3826-42bf-95bc-19806045eddc tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2" status: 200 len: 1511 microversion: 2.1 time: 0.526827 Sep 20 04:54:13.294481 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 130/237] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:12 2022] GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 => generated 1511 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:54:14.328112 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-9f585ef8-77da-4189-ba02-7baccc6f4b39 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:14.328718 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-9f585ef8-77da-4189-ba02-7baccc6f4b39 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:14.347523 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-9f585ef8-77da-4189-ba02-7baccc6f4b39 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:14.353326 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-9f585ef8-77da-4189-ba02-7baccc6f4b39 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:14.353965 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-9f585ef8-77da-4189-ba02-7baccc6f4b39 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:14.356255 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-9f585ef8-77da-4189-ba02-7baccc6f4b39 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:14.356919 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-9f585ef8-77da-4189-ba02-7baccc6f4b39 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:14.358364 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-9f585ef8-77da-4189-ba02-7baccc6f4b39 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:14.838890 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-9f585ef8-77da-4189-ba02-7baccc6f4b39 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:14.851798 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-9f585ef8-77da-4189-ba02-7baccc6f4b39 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2" status: 200 len: 1511 microversion: 2.1 time: 0.527457 Sep 20 04:54:14.855665 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 108/238] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:14 2022] GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 => generated 1511 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:54:15.713869 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-332642b0-2029-426b-9d91-51db248ea6b7 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2022752684", "imageRef": "080ea053-830e-4470-a886-0ab99b0ab3e0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "637b3136-e650-47ef-a9fe-492091eb8174"}], "security_groups": [{"name": "tempest-securitygroup--951382041"}], "key_name": "tempest-keypair-1653829936", "user_data": "}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:54:15.884458 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-da0dc2f6-83ca-41ee-b3ad-2c7391a92574 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:15.885411 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-da0dc2f6-83ca-41ee-b3ad-2c7391a92574 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:15.901682 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-da0dc2f6-83ca-41ee-b3ad-2c7391a92574 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:15.903285 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-da0dc2f6-83ca-41ee-b3ad-2c7391a92574 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:15.903825 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-da0dc2f6-83ca-41ee-b3ad-2c7391a92574 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:15.907266 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-da0dc2f6-83ca-41ee-b3ad-2c7391a92574 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:15.907846 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-da0dc2f6-83ca-41ee-b3ad-2c7391a92574 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:15.908361 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-da0dc2f6-83ca-41ee-b3ad-2c7391a92574 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:15.946494 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.network.neutron [None req-332642b0-2029-426b-9d91-51db248ea6b7 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] validate_networks() for [('637b3136-e650-47ef-a9fe-492091eb8174', None, None, None, None, None)] {{(pid=126813) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 20 04:54:16.211843 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-da0dc2f6-83ca-41ee-b3ad-2c7391a92574 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:16.222052 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-da0dc2f6-83ca-41ee-b3ad-2c7391a92574 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2" status: 200 len: 1511 microversion: 2.1 time: 0.341236 Sep 20 04:54:16.224043 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 109/239] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:15 2022] GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 => generated 1511 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:54:16.542443 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-332642b0-2029-426b-9d91-51db248ea6b7 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Flavor limits 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 20 04:54:16.543048 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-332642b0-2029-426b-9d91-51db248ea6b7 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Image limits 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 20 04:54:16.543635 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-332642b0-2029-426b-9d91-51db248ea6b7 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Flavor pref 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 20 04:54:16.544238 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-332642b0-2029-426b-9d91-51db248ea6b7 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Image pref 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 20 04:54:16.544830 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-332642b0-2029-426b-9d91-51db248ea6b7 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 20 04:54:16.556010 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-332642b0-2029-426b-9d91-51db248ea6b7 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:16.556502 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-332642b0-2029-426b-9d91-51db248ea6b7 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:16.556990 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-332642b0-2029-426b-9d91-51db248ea6b7 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:16.557705 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-332642b0-2029-426b-9d91-51db248ea6b7 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:16.558306 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-332642b0-2029-426b-9d91-51db248ea6b7 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:16.558863 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-332642b0-2029-426b-9d91-51db248ea6b7 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:16.586533 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-332642b0-2029-426b-9d91-51db248ea6b7 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Getting quotas for project 4f0f0b8842ae496292c27a6ee1350d32. Resources: {'ram', 'cores', 'instances'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 04:54:16.591214 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-332642b0-2029-426b-9d91-51db248ea6b7 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Getting quotas for user c93f22104a7b4a7caf0cc8b7180ffc55 and project 4f0f0b8842ae496292c27a6ee1350d32. Resources: {'ram', 'cores', 'instances'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 04:54:16.613422 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-332642b0-2029-426b-9d91-51db248ea6b7 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Going to run 1 instances... {{(pid=126813) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 20 04:54:16.618229 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-332642b0-2029-426b-9d91-51db248ea6b7 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 60372fad-5a9d-4d04-89e4-8aca10601222] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='080ea053-830e-4470-a886-0ab99b0ab3e0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126813) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 20 04:54:16.683950 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-332642b0-2029-426b-9d91-51db248ea6b7 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.977860 Sep 20 04:54:16.685331 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 131/240] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Sep 20 04:54:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 980 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 20 04:54:16.697532 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-82e3603c-609c-420f-a565-262bed669f07 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:16.698417 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-82e3603c-609c-420f-a565-262bed669f07 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 60372fad-5a9d-4d04-89e4-8aca10601222] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:16.780769 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-82e3603c-609c-420f-a565-262bed669f07 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:16.789528 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-82e3603c-609c-420f-a565-262bed669f07 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222" status: 200 len: 1242 microversion: 2.1 time: 0.096580 Sep 20 04:54:16.790573 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 110/241] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:16 2022] GET /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222 => generated 1242 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:54:17.262765 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-ee1698fb-251a-432c-9cea-3d3ea69d65c3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:17.263462 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-ee1698fb-251a-432c-9cea-3d3ea69d65c3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:17.275324 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-ee1698fb-251a-432c-9cea-3d3ea69d65c3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:17.280566 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-ee1698fb-251a-432c-9cea-3d3ea69d65c3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:17.281245 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-ee1698fb-251a-432c-9cea-3d3ea69d65c3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:17.282182 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-ee1698fb-251a-432c-9cea-3d3ea69d65c3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:17.282942 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-ee1698fb-251a-432c-9cea-3d3ea69d65c3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:17.283119 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-ee1698fb-251a-432c-9cea-3d3ea69d65c3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:17.576813 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-ee1698fb-251a-432c-9cea-3d3ea69d65c3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:17.590388 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-ee1698fb-251a-432c-9cea-3d3ea69d65c3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2" status: 200 len: 1517 microversion: 2.1 time: 0.346512 Sep 20 04:54:17.591187 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 111/242] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:17 2022] GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 => generated 1517 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:54:17.745778 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-21c837ff-25cf-450a-8694-372c197d88c1 tempest-TestShelveInstance-175665765 tempest-TestShelveInstance-175665765-project] Action: 'create', calling method: .version_select at 0x7f2e4a7cc1f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1643038489", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD53DiDYXCXjRx0hXdRGYe5x1vryn+VI0ReHzq+qCQWE4QXf7xBdRDBSO182tVIuVjtXBcuhR80GgvP+yHTbBdvVc45SaGd8DqOhDyLG0h1nQi7iqh5Enr+GH8yC0JQ5pg=="}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:54:17.815771 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-70d470c5-35a5-4a67-ab95-79aa5925fc4e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:17.816422 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-70d470c5-35a5-4a67-ab95-79aa5925fc4e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 60372fad-5a9d-4d04-89e4-8aca10601222] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:17.829571 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-21c837ff-25cf-450a-8694-372c197d88c1 tempest-TestShelveInstance-175665765 tempest-TestShelveInstance-175665765-project] Getting quotas for project 2e65f62fae68435ea0304bebc2a21b90. Resources: {'key_pairs'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 04:54:17.829791 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-70d470c5-35a5-4a67-ab95-79aa5925fc4e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:17.832389 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-70d470c5-35a5-4a67-ab95-79aa5925fc4e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:17.834443 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-70d470c5-35a5-4a67-ab95-79aa5925fc4e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:17.836562 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-70d470c5-35a5-4a67-ab95-79aa5925fc4e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:17.837984 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-70d470c5-35a5-4a67-ab95-79aa5925fc4e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:17.839341 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-70d470c5-35a5-4a67-ab95-79aa5925fc4e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:17.839762 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-21c837ff-25cf-450a-8694-372c197d88c1 tempest-TestShelveInstance-175665765 tempest-TestShelveInstance-175665765-project] Getting quotas for user 4f45aecdffb641d696b8c05d676f71aa and project 2e65f62fae68435ea0304bebc2a21b90. Resources: {'key_pairs'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 04:54:17.890526 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-21c837ff-25cf-450a-8694-372c197d88c1 tempest-TestShelveInstance-175665765 tempest-TestShelveInstance-175665765-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.655555 Sep 20 04:54:17.891483 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 132/243] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Sep 20 04:54:17 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:54:18.011316 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-70d470c5-35a5-4a67-ab95-79aa5925fc4e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:18.034131 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-70d470c5-35a5-4a67-ab95-79aa5925fc4e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222" status: 200 len: 1246 microversion: 2.1 time: 0.209937 Sep 20 04:54:18.034828 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 112/244] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:17 2022] GET /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222 => generated 1246 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:54:19.061807 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-516d7ee5-2d52-4acd-bae7-331db36a1c9e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:19.063182 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-516d7ee5-2d52-4acd-bae7-331db36a1c9e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 60372fad-5a9d-4d04-89e4-8aca10601222] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:19.071564 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=5 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:54:19.074520 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-516d7ee5-2d52-4acd-bae7-331db36a1c9e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:19.075656 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-516d7ee5-2d52-4acd-bae7-331db36a1c9e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:19.076572 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-516d7ee5-2d52-4acd-bae7-331db36a1c9e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:19.085591 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-516d7ee5-2d52-4acd-bae7-331db36a1c9e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:19.086448 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-516d7ee5-2d52-4acd-bae7-331db36a1c9e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:19.087473 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-516d7ee5-2d52-4acd-bae7-331db36a1c9e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:19.129186 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:54:19.198260 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-516d7ee5-2d52-4acd-bae7-331db36a1c9e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:19.206159 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-516d7ee5-2d52-4acd-bae7-331db36a1c9e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222" status: 200 len: 1312 microversion: 2.1 time: 0.151668 Sep 20 04:54:19.206727 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 133/245] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:19 2022] GET /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222 => generated 1312 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:54:19.589963 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-0c41a0dc-0c59-422c-93d9-a7cead814510 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Action: 'create', calling method: .version_select at 0x7f2e4a92e550>, body: {"keypair": {"name": "tempest-keypair-879821796", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCU5ss3vcKaNnj4I3IYAeHxqrZORv5bHT0QHvAVlPZnF2eOQ/wyraCNbJRLWyPVG21/At/4tK/k23LZE9Nunk4wUISdeiR1nLnK5qoI3ZC3Rli+8YIcZ3hdLHHiybXfWtA=="}} {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:54:19.607681 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG dbcounter [-] [126814] Writing DB stats nova_api:SELECT=36 {{(pid=126814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:54:19.617944 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.quota [None req-0c41a0dc-0c59-422c-93d9-a7cead814510 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Getting quotas for project 5f0a24f6f6994f45bd314d3009b0a572. Resources: {'key_pairs'} {{(pid=126814) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 04:54:19.622032 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.quota [None req-0c41a0dc-0c59-422c-93d9-a7cead814510 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Getting quotas for user 49f80b68650940e8850cbd4f84a49ef4 and project 5f0a24f6f6994f45bd314d3009b0a572. Resources: {'key_pairs'} {{(pid=126814) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 04:54:19.651616 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-10e20816-2f0f-4ed4-ac16-923edd2b1a73 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2009974886", "imageRef": "080ea053-830e-4470-a886-0ab99b0ab3e0", "flavorRef": "452", "networks": [{"uuid": "5a2e8ba6-6e30-4ff7-bf9d-8b3fbb5df340"}]}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:54:19.678022 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-0c41a0dc-0c59-422c-93d9-a7cead814510 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.091977 Sep 20 04:54:19.678760 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 113/246] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Sep 20 04:54:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:54:19.761521 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.network.neutron [None req-10e20816-2f0f-4ed4-ac16-923edd2b1a73 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] validate_networks() for [('5a2e8ba6-6e30-4ff7-bf9d-8b3fbb5df340', None, None, None, None, None)] {{(pid=126813) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 20 04:54:20.234574 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-f826f0eb-9c9f-4523-9c0b-3826a6eafc4c tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:20.235477 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-f826f0eb-9c9f-4523-9c0b-3826a6eafc4c tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 60372fad-5a9d-4d04-89e4-8aca10601222] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:20.255131 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-f826f0eb-9c9f-4523-9c0b-3826a6eafc4c tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:20.255650 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-f826f0eb-9c9f-4523-9c0b-3826a6eafc4c tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:20.260589 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-f826f0eb-9c9f-4523-9c0b-3826a6eafc4c tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:20.262965 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-f826f0eb-9c9f-4523-9c0b-3826a6eafc4c tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:20.263458 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-f826f0eb-9c9f-4523-9c0b-3826a6eafc4c tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:20.263901 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-f826f0eb-9c9f-4523-9c0b-3826a6eafc4c tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:20.825214 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-f826f0eb-9c9f-4523-9c0b-3826a6eafc4c tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:20.834870 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-f826f0eb-9c9f-4523-9c0b-3826a6eafc4c tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222" status: 200 len: 1367 microversion: 2.1 time: 0.607173 Sep 20 04:54:20.835460 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 114/247] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:20 2022] GET /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222 => generated 1367 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:54:20.935034 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-10e20816-2f0f-4ed4-ac16-923edd2b1a73 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Flavor limits 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 20 04:54:20.936078 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-10e20816-2f0f-4ed4-ac16-923edd2b1a73 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Image limits 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 20 04:54:20.937660 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-10e20816-2f0f-4ed4-ac16-923edd2b1a73 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Flavor pref 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 20 04:54:20.938519 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-10e20816-2f0f-4ed4-ac16-923edd2b1a73 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Image pref 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 20 04:54:20.939231 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-10e20816-2f0f-4ed4-ac16-923edd2b1a73 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 20 04:54:20.963290 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-10e20816-2f0f-4ed4-ac16-923edd2b1a73 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:20.964045 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-10e20816-2f0f-4ed4-ac16-923edd2b1a73 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:20.964759 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-10e20816-2f0f-4ed4-ac16-923edd2b1a73 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:20.965715 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-10e20816-2f0f-4ed4-ac16-923edd2b1a73 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:20.966456 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-10e20816-2f0f-4ed4-ac16-923edd2b1a73 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:20.967103 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-10e20816-2f0f-4ed4-ac16-923edd2b1a73 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:20.989841 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-10e20816-2f0f-4ed4-ac16-923edd2b1a73 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Getting quotas for project 725d386301d648de85fd6c4767250c58. Resources: {'ram', 'cores', 'instances'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 04:54:21.001150 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-10e20816-2f0f-4ed4-ac16-923edd2b1a73 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Getting quotas for user b3d877f0c71f4e18854813780214ed6a and project 725d386301d648de85fd6c4767250c58. Resources: {'ram', 'cores', 'instances'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 04:54:21.034107 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-10e20816-2f0f-4ed4-ac16-923edd2b1a73 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Going to run 1 instances... {{(pid=126813) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 20 04:54:21.039415 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-10e20816-2f0f-4ed4-ac16-923edd2b1a73 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] [instance: f024434a-d44b-41f9-8818-da15a5d0a52d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='080ea053-830e-4470-a886-0ab99b0ab3e0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126813) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 20 04:54:21.180487 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-10e20816-2f0f-4ed4-ac16-923edd2b1a73 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.528902 Sep 20 04:54:21.181844 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 134/248] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Sep 20 04:54:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 20 04:54:21.197487 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-a5343b4b-6af8-46d5-b496-f18249acda2d tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:21.198467 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-a5343b4b-6af8-46d5-b496-f18249acda2d tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] [instance: f024434a-d44b-41f9-8818-da15a5d0a52d] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:21.332339 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-a5343b4b-6af8-46d5-b496-f18249acda2d tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d877f0c71f4e18854813780214ed6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725d386301d648de85fd6c4767250c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:21.341431 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-a5343b4b-6af8-46d5-b496-f18249acda2d tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] 10.222.0.27 "GET /compute/v2.1/servers/f024434a-d44b-41f9-8818-da15a5d0a52d" status: 200 len: 1219 microversion: 2.1 time: 0.152011 Sep 20 04:54:21.344455 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 115/249] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:21 2022] GET /compute/v2.1/servers/f024434a-d44b-41f9-8818-da15a5d0a52d => generated 1219 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:54:21.863160 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-894e167f-e327-4151-8257-1d26c024afdf tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:21.864127 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-894e167f-e327-4151-8257-1d26c024afdf tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 60372fad-5a9d-4d04-89e4-8aca10601222] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:21.882498 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-894e167f-e327-4151-8257-1d26c024afdf tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:21.884485 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-894e167f-e327-4151-8257-1d26c024afdf tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:21.886673 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-894e167f-e327-4151-8257-1d26c024afdf tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:21.887659 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-894e167f-e327-4151-8257-1d26c024afdf tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:21.889154 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-894e167f-e327-4151-8257-1d26c024afdf tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:21.890895 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-894e167f-e327-4151-8257-1d26c024afdf tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:21.974376 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [req-d20db641-4a8a-4de7-a681-1abd3e7fae06 req-b391f842-436b-455e-9ae0-b6ce7560e464 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60372fad-5a9d-4d04-89e4-8aca10601222", "tag": "9143766c-b4ab-434b-8c53-ed214e20f104"}]} {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:54:21.992488 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [req-d20db641-4a8a-4de7-a681-1abd3e7fae06 req-b391f842-436b-455e-9ae0-b6ce7560e464 service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:21.993275 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [req-d20db641-4a8a-4de7-a681-1abd3e7fae06 req-b391f842-436b-455e-9ae0-b6ce7560e464 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:21.993896 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [req-d20db641-4a8a-4de7-a681-1abd3e7fae06 req-b391f842-436b-455e-9ae0-b6ce7560e464 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:22.008658 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.compute.server_external_events [req-d20db641-4a8a-4de7-a681-1abd3e7fae06 req-b391f842-436b-455e-9ae0-b6ce7560e464 service nova] Creating event network-changed:9143766c-b4ab-434b-8c53-ed214e20f104 for instance 60372fad-5a9d-4d04-89e4-8aca10601222 on hv-cinder-75671 Sep 20 04:54:22.015281 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [req-d20db641-4a8a-4de7-a681-1abd3e7fae06 req-b391f842-436b-455e-9ae0-b6ce7560e464 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045271 Sep 20 04:54:22.017029 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 116/250] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 04:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 04:54:22.320096 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-894e167f-e327-4151-8257-1d26c024afdf tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:22.331775 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-894e167f-e327-4151-8257-1d26c024afdf tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222" status: 200 len: 1367 microversion: 2.1 time: 0.470229 Sep 20 04:54:22.333583 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 135/251] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:21 2022] GET /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222 => generated 1367 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:54:22.369165 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-96d48b90-e8ed-4f49-981a-45e75f5501f3 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:22.369975 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-96d48b90-e8ed-4f49-981a-45e75f5501f3 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] [instance: f024434a-d44b-41f9-8818-da15a5d0a52d] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:22.376036 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-2cbaea25-cc87-4ccf-ac36-f2f9d2ccc00d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1456928068", "imageRef": "080ea053-830e-4470-a886-0ab99b0ab3e0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7f03bfe9-ec72-45e7-b49d-83e075955154"}], "security_groups": [{"name": "tempest-securitygroup--928918808"}], "key_name": "tempest-keypair-879821796", "user_data": "}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:54:22.398672 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-96d48b90-e8ed-4f49-981a-45e75f5501f3 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:22.400082 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-96d48b90-e8ed-4f49-981a-45e75f5501f3 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:22.401417 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-96d48b90-e8ed-4f49-981a-45e75f5501f3 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:22.402443 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-96d48b90-e8ed-4f49-981a-45e75f5501f3 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:22.403116 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-96d48b90-e8ed-4f49-981a-45e75f5501f3 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:22.403892 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-96d48b90-e8ed-4f49-981a-45e75f5501f3 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:22.537111 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-96d48b90-e8ed-4f49-981a-45e75f5501f3 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d877f0c71f4e18854813780214ed6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725d386301d648de85fd6c4767250c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:22.550482 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-96d48b90-e8ed-4f49-981a-45e75f5501f3 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] 10.222.0.27 "GET /compute/v2.1/servers/f024434a-d44b-41f9-8818-da15a5d0a52d" status: 200 len: 1271 microversion: 2.1 time: 0.186531 Sep 20 04:54:22.553340 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 117/252] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:22 2022] GET /compute/v2.1/servers/f024434a-d44b-41f9-8818-da15a5d0a52d => generated 1271 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:54:23.368880 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-fe95e23c-94c5-40e9-bb24-b0fc2427f05d tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:23.368880 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-fe95e23c-94c5-40e9-bb24-b0fc2427f05d tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 60372fad-5a9d-4d04-89e4-8aca10601222] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:23.384046 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-fe95e23c-94c5-40e9-bb24-b0fc2427f05d tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:23.384046 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-fe95e23c-94c5-40e9-bb24-b0fc2427f05d tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:23.384046 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-fe95e23c-94c5-40e9-bb24-b0fc2427f05d tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:23.384731 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-fe95e23c-94c5-40e9-bb24-b0fc2427f05d tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:23.384731 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-fe95e23c-94c5-40e9-bb24-b0fc2427f05d tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:23.385058 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-fe95e23c-94c5-40e9-bb24-b0fc2427f05d tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:23.531728 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-fe95e23c-94c5-40e9-bb24-b0fc2427f05d tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:23.539412 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-fe95e23c-94c5-40e9-bb24-b0fc2427f05d tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222" status: 200 len: 1367 microversion: 2.1 time: 0.177485 Sep 20 04:54:23.539971 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 118/253] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:23 2022] GET /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:54:23.575433 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-5dfa2f3b-b75b-4ada-8ba2-0466c5b0c467 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:23.576047 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-5dfa2f3b-b75b-4ada-8ba2-0466c5b0c467 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] [instance: f024434a-d44b-41f9-8818-da15a5d0a52d] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:23.582147 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-5dfa2f3b-b75b-4ada-8ba2-0466c5b0c467 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:23.582629 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-5dfa2f3b-b75b-4ada-8ba2-0466c5b0c467 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:23.583067 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-5dfa2f3b-b75b-4ada-8ba2-0466c5b0c467 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:23.583754 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-5dfa2f3b-b75b-4ada-8ba2-0466c5b0c467 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:23.584209 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-5dfa2f3b-b75b-4ada-8ba2-0466c5b0c467 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:23.584657 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-5dfa2f3b-b75b-4ada-8ba2-0466c5b0c467 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:23.647482 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-5dfa2f3b-b75b-4ada-8ba2-0466c5b0c467 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d877f0c71f4e18854813780214ed6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725d386301d648de85fd6c4767250c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:23.655304 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-5dfa2f3b-b75b-4ada-8ba2-0466c5b0c467 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] 10.222.0.27 "GET /compute/v2.1/servers/f024434a-d44b-41f9-8818-da15a5d0a52d" status: 200 len: 1289 microversion: 2.1 time: 0.083938 Sep 20 04:54:23.655874 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 119/254] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:23 2022] GET /compute/v2.1/servers/f024434a-d44b-41f9-8818-da15a5d0a52d => generated 1289 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:54:24.570547 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-32f17bf9-f2d7-4cc5-b1dd-4a2a2a01c866 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:24.571247 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-32f17bf9-f2d7-4cc5-b1dd-4a2a2a01c866 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 60372fad-5a9d-4d04-89e4-8aca10601222] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:24.584667 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-32f17bf9-f2d7-4cc5-b1dd-4a2a2a01c866 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:24.585547 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-32f17bf9-f2d7-4cc5-b1dd-4a2a2a01c866 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:24.587548 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-32f17bf9-f2d7-4cc5-b1dd-4a2a2a01c866 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:24.588642 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-32f17bf9-f2d7-4cc5-b1dd-4a2a2a01c866 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:24.589874 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-32f17bf9-f2d7-4cc5-b1dd-4a2a2a01c866 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:24.590617 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-32f17bf9-f2d7-4cc5-b1dd-4a2a2a01c866 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:25.047252 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-32f17bf9-f2d7-4cc5-b1dd-4a2a2a01c866 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:25.058456 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-32f17bf9-f2d7-4cc5-b1dd-4a2a2a01c866 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222" status: 200 len: 1367 microversion: 2.1 time: 0.497925 Sep 20 04:54:25.059198 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 120/255] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:24 2022] GET /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222 => generated 1367 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:54:25.065853 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-2640cf23-fe66-4fd9-a573-8ce988a86f52 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:25.067869 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-2640cf23-fe66-4fd9-a573-8ce988a86f52 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] [instance: f024434a-d44b-41f9-8818-da15a5d0a52d] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:25.076814 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-2640cf23-fe66-4fd9-a573-8ce988a86f52 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:25.077694 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-2640cf23-fe66-4fd9-a573-8ce988a86f52 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:25.078384 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-2640cf23-fe66-4fd9-a573-8ce988a86f52 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:25.079170 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-2640cf23-fe66-4fd9-a573-8ce988a86f52 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:25.079849 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-2640cf23-fe66-4fd9-a573-8ce988a86f52 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:25.080384 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-2640cf23-fe66-4fd9-a573-8ce988a86f52 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:25.155917 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-2640cf23-fe66-4fd9-a573-8ce988a86f52 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d877f0c71f4e18854813780214ed6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725d386301d648de85fd6c4767250c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:25.164802 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-2640cf23-fe66-4fd9-a573-8ce988a86f52 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] 10.222.0.27 "GET /compute/v2.1/servers/f024434a-d44b-41f9-8818-da15a5d0a52d" status: 200 len: 1277 microversion: 2.1 time: 0.103562 Sep 20 04:54:25.165400 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 121/256] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:25 2022] GET /compute/v2.1/servers/f024434a-d44b-41f9-8818-da15a5d0a52d => generated 1277 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:54:26.016930 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [req-25659497-fb8c-4dcf-8cce-891ff1e653d5 req-99d5c263-286c-485e-ba0b-17213749cd8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f024434a-d44b-41f9-8818-da15a5d0a52d", "tag": "d063bff7-96f4-43ab-aeaf-6b6e6cab44e0"}]} {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:54:26.028343 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [req-25659497-fb8c-4dcf-8cce-891ff1e653d5 req-99d5c263-286c-485e-ba0b-17213749cd8f service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:26.028869 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [req-25659497-fb8c-4dcf-8cce-891ff1e653d5 req-99d5c263-286c-485e-ba0b-17213749cd8f service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:26.029302 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [req-25659497-fb8c-4dcf-8cce-891ff1e653d5 req-99d5c263-286c-485e-ba0b-17213749cd8f service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:26.041141 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.compute.server_external_events [req-25659497-fb8c-4dcf-8cce-891ff1e653d5 req-99d5c263-286c-485e-ba0b-17213749cd8f service nova] Creating event network-changed:d063bff7-96f4-43ab-aeaf-6b6e6cab44e0 for instance f024434a-d44b-41f9-8818-da15a5d0a52d on hv-cinder-75671 Sep 20 04:54:26.048070 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [req-25659497-fb8c-4dcf-8cce-891ff1e653d5 req-99d5c263-286c-485e-ba0b-17213749cd8f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035301 Sep 20 04:54:26.048711 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 122/257] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 04:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:54:26.087417 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-70af3220-38b4-474f-8a61-6872434ef150 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:26.088290 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-70af3220-38b4-474f-8a61-6872434ef150 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 60372fad-5a9d-4d04-89e4-8aca10601222] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:26.094472 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-70af3220-38b4-474f-8a61-6872434ef150 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:26.094953 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-70af3220-38b4-474f-8a61-6872434ef150 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:26.095390 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-70af3220-38b4-474f-8a61-6872434ef150 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:26.096209 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-70af3220-38b4-474f-8a61-6872434ef150 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:26.096687 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-70af3220-38b4-474f-8a61-6872434ef150 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:26.097434 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-70af3220-38b4-474f-8a61-6872434ef150 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:26.230501 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-70af3220-38b4-474f-8a61-6872434ef150 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:26.239762 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-70af3220-38b4-474f-8a61-6872434ef150 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222" status: 200 len: 1367 microversion: 2.1 time: 0.157167 Sep 20 04:54:26.240755 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 123/258] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:26 2022] GET /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:54:26.245365 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-6edef3c6-f71d-4a4f-9d9d-d35797d7ac6e tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:26.245980 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-6edef3c6-f71d-4a4f-9d9d-d35797d7ac6e tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] [instance: f024434a-d44b-41f9-8818-da15a5d0a52d] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:26.251963 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-6edef3c6-f71d-4a4f-9d9d-d35797d7ac6e tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:26.252447 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-6edef3c6-f71d-4a4f-9d9d-d35797d7ac6e tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:26.252988 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-6edef3c6-f71d-4a4f-9d9d-d35797d7ac6e tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:26.255198 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-6edef3c6-f71d-4a4f-9d9d-d35797d7ac6e tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:26.255690 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-6edef3c6-f71d-4a4f-9d9d-d35797d7ac6e tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:26.256144 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-6edef3c6-f71d-4a4f-9d9d-d35797d7ac6e tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:26.389513 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-6edef3c6-f71d-4a4f-9d9d-d35797d7ac6e tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d877f0c71f4e18854813780214ed6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725d386301d648de85fd6c4767250c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:26.397712 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-6edef3c6-f71d-4a4f-9d9d-d35797d7ac6e tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] 10.222.0.27 "GET /compute/v2.1/servers/f024434a-d44b-41f9-8818-da15a5d0a52d" status: 200 len: 1319 microversion: 2.1 time: 0.156001 Sep 20 04:54:26.398276 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 124/259] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:26 2022] GET /compute/v2.1/servers/f024434a-d44b-41f9-8818-da15a5d0a52d => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:54:27.263648 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-e65172c9-393c-410f-81a9-21098d3db452 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:27.264472 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-e65172c9-393c-410f-81a9-21098d3db452 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 60372fad-5a9d-4d04-89e4-8aca10601222] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:27.272044 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-e65172c9-393c-410f-81a9-21098d3db452 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:27.272531 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-e65172c9-393c-410f-81a9-21098d3db452 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:27.273006 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-e65172c9-393c-410f-81a9-21098d3db452 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:27.273714 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-e65172c9-393c-410f-81a9-21098d3db452 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:27.274165 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-e65172c9-393c-410f-81a9-21098d3db452 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:27.274589 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-e65172c9-393c-410f-81a9-21098d3db452 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:27.292014 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG dbcounter [-] [126814] Writing DB stats nova_cell1:SELECT=100 {{(pid=126814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:54:27.410924 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-e65172c9-393c-410f-81a9-21098d3db452 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:27.418589 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-e65172c9-393c-410f-81a9-21098d3db452 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222" status: 200 len: 1367 microversion: 2.1 time: 0.158801 Sep 20 04:54:27.419148 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 125/260] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:27 2022] GET /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:54:27.423549 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-12324437-9165-47c9-92a5-5bfc93fc4878 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:27.424143 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-12324437-9165-47c9-92a5-5bfc93fc4878 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] [instance: f024434a-d44b-41f9-8818-da15a5d0a52d] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:27.430060 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-12324437-9165-47c9-92a5-5bfc93fc4878 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:27.430544 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-12324437-9165-47c9-92a5-5bfc93fc4878 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:27.430992 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-12324437-9165-47c9-92a5-5bfc93fc4878 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:27.431667 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-12324437-9165-47c9-92a5-5bfc93fc4878 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:27.432117 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-12324437-9165-47c9-92a5-5bfc93fc4878 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:27.432538 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-12324437-9165-47c9-92a5-5bfc93fc4878 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:27.566471 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-12324437-9165-47c9-92a5-5bfc93fc4878 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d877f0c71f4e18854813780214ed6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725d386301d648de85fd6c4767250c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:27.574155 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-12324437-9165-47c9-92a5-5bfc93fc4878 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] 10.222.0.27 "GET /compute/v2.1/servers/f024434a-d44b-41f9-8818-da15a5d0a52d" status: 200 len: 1319 microversion: 2.1 time: 0.154046 Sep 20 04:54:27.574715 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 126/261] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:27 2022] GET /compute/v2.1/servers/f024434a-d44b-41f9-8818-da15a5d0a52d => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:54:28.442782 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-cb72ac67-6b5b-43ca-9f47-f707ac7802e9 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:28.444442 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-cb72ac67-6b5b-43ca-9f47-f707ac7802e9 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 60372fad-5a9d-4d04-89e4-8aca10601222] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:28.452036 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-cb72ac67-6b5b-43ca-9f47-f707ac7802e9 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:28.452518 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-cb72ac67-6b5b-43ca-9f47-f707ac7802e9 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:28.452982 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-cb72ac67-6b5b-43ca-9f47-f707ac7802e9 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:28.453675 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-cb72ac67-6b5b-43ca-9f47-f707ac7802e9 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:28.454118 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-cb72ac67-6b5b-43ca-9f47-f707ac7802e9 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:28.454534 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-cb72ac67-6b5b-43ca-9f47-f707ac7802e9 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:28.672256 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-cb72ac67-6b5b-43ca-9f47-f707ac7802e9 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:28.680964 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-cb72ac67-6b5b-43ca-9f47-f707ac7802e9 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222" status: 200 len: 1367 microversion: 2.1 time: 0.242139 Sep 20 04:54:28.696830 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 127/262] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:28 2022] GET /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222 => generated 1367 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:54:28.702432 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-07b0d07a-2c52-4c04-af39-698e9868e5fc tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:28.703250 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-07b0d07a-2c52-4c04-af39-698e9868e5fc tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] [instance: f024434a-d44b-41f9-8818-da15a5d0a52d] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:28.710184 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-07b0d07a-2c52-4c04-af39-698e9868e5fc tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:28.710671 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-07b0d07a-2c52-4c04-af39-698e9868e5fc tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:28.712005 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-07b0d07a-2c52-4c04-af39-698e9868e5fc tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:28.712730 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-07b0d07a-2c52-4c04-af39-698e9868e5fc tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:28.713179 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-07b0d07a-2c52-4c04-af39-698e9868e5fc tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:28.713594 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-07b0d07a-2c52-4c04-af39-698e9868e5fc tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:28.888028 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-07b0d07a-2c52-4c04-af39-698e9868e5fc tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d877f0c71f4e18854813780214ed6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725d386301d648de85fd6c4767250c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:28.896453 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-07b0d07a-2c52-4c04-af39-698e9868e5fc tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] 10.222.0.27 "GET /compute/v2.1/servers/f024434a-d44b-41f9-8818-da15a5d0a52d" status: 200 len: 1319 microversion: 2.1 time: 0.198504 Sep 20 04:54:28.897066 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 128/263] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:28 2022] GET /compute/v2.1/servers/f024434a-d44b-41f9-8818-da15a5d0a52d => generated 1319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:54:29.709317 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-d125331c-3d15-43ab-904e-cd102a49a1d5 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:29.710036 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-d125331c-3d15-43ab-904e-cd102a49a1d5 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 60372fad-5a9d-4d04-89e4-8aca10601222] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:29.717022 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-d125331c-3d15-43ab-904e-cd102a49a1d5 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:29.717508 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-d125331c-3d15-43ab-904e-cd102a49a1d5 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:29.717941 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-d125331c-3d15-43ab-904e-cd102a49a1d5 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:29.718715 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-d125331c-3d15-43ab-904e-cd102a49a1d5 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:29.719334 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-d125331c-3d15-43ab-904e-cd102a49a1d5 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:29.719796 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-d125331c-3d15-43ab-904e-cd102a49a1d5 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:29.874875 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-d125331c-3d15-43ab-904e-cd102a49a1d5 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:29.883244 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-d125331c-3d15-43ab-904e-cd102a49a1d5 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222" status: 200 len: 1367 microversion: 2.1 time: 0.182861 Sep 20 04:54:29.883809 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 129/264] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:29 2022] GET /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:54:29.918691 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-ac2e15ef-6924-4b80-bf82-ecd56292731b tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:29.919218 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-ac2e15ef-6924-4b80-bf82-ecd56292731b tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] [instance: f024434a-d44b-41f9-8818-da15a5d0a52d] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:29.924882 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-ac2e15ef-6924-4b80-bf82-ecd56292731b tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:29.925383 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-ac2e15ef-6924-4b80-bf82-ecd56292731b tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:29.925860 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-ac2e15ef-6924-4b80-bf82-ecd56292731b tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:29.926532 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-ac2e15ef-6924-4b80-bf82-ecd56292731b tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:29.926975 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-ac2e15ef-6924-4b80-bf82-ecd56292731b tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:29.927390 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-ac2e15ef-6924-4b80-bf82-ecd56292731b tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:30.056800 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-ac2e15ef-6924-4b80-bf82-ecd56292731b tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d877f0c71f4e18854813780214ed6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725d386301d648de85fd6c4767250c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:30.064720 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-ac2e15ef-6924-4b80-bf82-ecd56292731b tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] 10.222.0.27 "GET /compute/v2.1/servers/f024434a-d44b-41f9-8818-da15a5d0a52d" status: 200 len: 1319 microversion: 2.1 time: 0.149502 Sep 20 04:54:30.065290 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 130/265] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:29 2022] GET /compute/v2.1/servers/f024434a-d44b-41f9-8818-da15a5d0a52d => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:54:30.608492 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [req-0ffbed39-3c48-4930-9289-02414222cb3f req-f2dc415d-3fbf-4d08-9d1d-7a958f8df133 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60372fad-5a9d-4d04-89e4-8aca10601222", "name": "network-vif-plugged", "status": "completed", "tag": "9143766c-b4ab-434b-8c53-ed214e20f104"}]} {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:54:30.625745 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [req-0ffbed39-3c48-4930-9289-02414222cb3f req-f2dc415d-3fbf-4d08-9d1d-7a958f8df133 service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:30.626218 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [req-0ffbed39-3c48-4930-9289-02414222cb3f req-f2dc415d-3fbf-4d08-9d1d-7a958f8df133 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:30.629550 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [req-0ffbed39-3c48-4930-9289-02414222cb3f req-f2dc415d-3fbf-4d08-9d1d-7a958f8df133 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:30.641176 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.compute.server_external_events [req-0ffbed39-3c48-4930-9289-02414222cb3f req-f2dc415d-3fbf-4d08-9d1d-7a958f8df133 service nova] Creating event network-vif-plugged:9143766c-b4ab-434b-8c53-ed214e20f104 for instance 60372fad-5a9d-4d04-89e4-8aca10601222 on hv-cinder-75671 Sep 20 04:54:30.646922 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [req-0ffbed39-3c48-4930-9289-02414222cb3f req-f2dc415d-3fbf-4d08-9d1d-7a958f8df133 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042088 Sep 20 04:54:30.648047 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 131/266] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 04:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:54:30.725076 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.network.neutron [None req-2cbaea25-cc87-4ccf-ac36-f2f9d2ccc00d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] validate_networks() for [('7f03bfe9-ec72-45e7-b49d-83e075955154', None, None, None, None, None)] {{(pid=126813) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 20 04:54:30.915194 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-e583cf66-4bb5-49d0-8ea7-b31de84c8a5b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:30.916713 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-e583cf66-4bb5-49d0-8ea7-b31de84c8a5b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 60372fad-5a9d-4d04-89e4-8aca10601222] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:30.929282 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-e583cf66-4bb5-49d0-8ea7-b31de84c8a5b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:30.929981 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-e583cf66-4bb5-49d0-8ea7-b31de84c8a5b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:30.930561 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-e583cf66-4bb5-49d0-8ea7-b31de84c8a5b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:30.931421 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-e583cf66-4bb5-49d0-8ea7-b31de84c8a5b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:30.932876 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-e583cf66-4bb5-49d0-8ea7-b31de84c8a5b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:30.934475 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-e583cf66-4bb5-49d0-8ea7-b31de84c8a5b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:30.976643 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell0:SELECT=4 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:54:31.013855 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell0:SELECT=20 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:54:31.139916 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-e583cf66-4bb5-49d0-8ea7-b31de84c8a5b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:31.148846 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-e583cf66-4bb5-49d0-8ea7-b31de84c8a5b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222" status: 200 len: 1367 microversion: 2.1 time: 0.245756 Sep 20 04:54:31.154332 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 132/267] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:30 2022] GET /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222 => generated 1367 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:54:31.154332 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-d2dd9ccb-0500-464a-97df-900fa0b6e5c5 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:31.154906 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-d2dd9ccb-0500-464a-97df-900fa0b6e5c5 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] [instance: f024434a-d44b-41f9-8818-da15a5d0a52d] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:31.162535 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-d2dd9ccb-0500-464a-97df-900fa0b6e5c5 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:31.163899 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-d2dd9ccb-0500-464a-97df-900fa0b6e5c5 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:31.165186 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-d2dd9ccb-0500-464a-97df-900fa0b6e5c5 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:31.166210 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-d2dd9ccb-0500-464a-97df-900fa0b6e5c5 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:31.166795 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-d2dd9ccb-0500-464a-97df-900fa0b6e5c5 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:31.167307 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-d2dd9ccb-0500-464a-97df-900fa0b6e5c5 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:31.336719 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG dbcounter [-] [126814] Writing DB stats nova_cell0:SELECT=8 {{(pid=126814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:54:31.377712 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-d2dd9ccb-0500-464a-97df-900fa0b6e5c5 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d877f0c71f4e18854813780214ed6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725d386301d648de85fd6c4767250c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:31.386034 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-d2dd9ccb-0500-464a-97df-900fa0b6e5c5 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] 10.222.0.27 "GET /compute/v2.1/servers/f024434a-d44b-41f9-8818-da15a5d0a52d" status: 200 len: 1319 microversion: 2.1 time: 0.235336 Sep 20 04:54:31.386648 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 133/268] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:31 2022] GET /compute/v2.1/servers/f024434a-d44b-41f9-8818-da15a5d0a52d => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:54:31.471558 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-2cbaea25-cc87-4ccf-ac36-f2f9d2ccc00d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Flavor limits 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 20 04:54:31.471973 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-2cbaea25-cc87-4ccf-ac36-f2f9d2ccc00d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Image limits 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 20 04:54:31.473088 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-2cbaea25-cc87-4ccf-ac36-f2f9d2ccc00d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Flavor pref 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 20 04:54:31.473517 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-2cbaea25-cc87-4ccf-ac36-f2f9d2ccc00d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Image pref 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 20 04:54:31.473946 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-2cbaea25-cc87-4ccf-ac36-f2f9d2ccc00d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 20 04:54:31.482382 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2cbaea25-cc87-4ccf-ac36-f2f9d2ccc00d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:31.482854 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2cbaea25-cc87-4ccf-ac36-f2f9d2ccc00d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:31.483281 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2cbaea25-cc87-4ccf-ac36-f2f9d2ccc00d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:31.483996 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2cbaea25-cc87-4ccf-ac36-f2f9d2ccc00d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:31.484441 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2cbaea25-cc87-4ccf-ac36-f2f9d2ccc00d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:31.484888 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2cbaea25-cc87-4ccf-ac36-f2f9d2ccc00d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:31.501429 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-2cbaea25-cc87-4ccf-ac36-f2f9d2ccc00d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Getting quotas for project 5f0a24f6f6994f45bd314d3009b0a572. Resources: {'ram', 'cores', 'instances'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 04:54:31.505148 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-2cbaea25-cc87-4ccf-ac36-f2f9d2ccc00d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Getting quotas for user 49f80b68650940e8850cbd4f84a49ef4 and project 5f0a24f6f6994f45bd314d3009b0a572. Resources: {'ram', 'cores', 'instances'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 04:54:31.515689 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-2cbaea25-cc87-4ccf-ac36-f2f9d2ccc00d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Going to run 1 instances... {{(pid=126813) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 20 04:54:31.517817 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-2cbaea25-cc87-4ccf-ac36-f2f9d2ccc00d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='080ea053-830e-4470-a886-0ab99b0ab3e0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126813) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 20 04:54:31.569331 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-2cbaea25-cc87-4ccf-ac36-f2f9d2ccc00d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 9.197611 Sep 20 04:54:31.569981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 136/269] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Sep 20 04:54:22 2022] POST /compute/v2.1/servers => generated 408 bytes in 9199 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 20 04:54:31.581120 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-3a49a3fb-c6a6-4f5d-8824-11f1483b4362 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:31.581839 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-3a49a3fb-c6a6-4f5d-8824-11f1483b4362 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:31.640837 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-3a49a3fb-c6a6-4f5d-8824-11f1483b4362 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:31.648783 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-3a49a3fb-c6a6-4f5d-8824-11f1483b4362 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906" status: 200 len: 1245 microversion: 2.1 time: 0.071460 Sep 20 04:54:31.649691 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 134/270] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:31 2022] GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906 => generated 1245 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:54:32.178255 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-5feba674-2d23-43ee-b60c-aa7e28a1453b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:32.178860 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-5feba674-2d23-43ee-b60c-aa7e28a1453b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 60372fad-5a9d-4d04-89e4-8aca10601222] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:32.185036 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5feba674-2d23-43ee-b60c-aa7e28a1453b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:32.185515 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5feba674-2d23-43ee-b60c-aa7e28a1453b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:32.185943 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5feba674-2d23-43ee-b60c-aa7e28a1453b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:32.186618 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5feba674-2d23-43ee-b60c-aa7e28a1453b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:32.187063 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5feba674-2d23-43ee-b60c-aa7e28a1453b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:32.187482 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5feba674-2d23-43ee-b60c-aa7e28a1453b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:32.319347 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-5feba674-2d23-43ee-b60c-aa7e28a1453b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:32.327054 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-5feba674-2d23-43ee-b60c-aa7e28a1453b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222" status: 200 len: 1367 microversion: 2.1 time: 0.153660 Sep 20 04:54:32.327622 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 137/271] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:32 2022] GET /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:54:32.411756 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-987ea654-9c99-425f-8c08-f538dba597ca tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:32.412592 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-987ea654-9c99-425f-8c08-f538dba597ca tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] [instance: f024434a-d44b-41f9-8818-da15a5d0a52d] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:32.419938 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-987ea654-9c99-425f-8c08-f538dba597ca tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:32.420424 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-987ea654-9c99-425f-8c08-f538dba597ca tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:32.420894 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-987ea654-9c99-425f-8c08-f538dba597ca tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:32.421591 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-987ea654-9c99-425f-8c08-f538dba597ca tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:32.422073 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-987ea654-9c99-425f-8c08-f538dba597ca tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:32.422507 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-987ea654-9c99-425f-8c08-f538dba597ca tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:32.557359 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-987ea654-9c99-425f-8c08-f538dba597ca tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d877f0c71f4e18854813780214ed6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725d386301d648de85fd6c4767250c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:32.565212 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-987ea654-9c99-425f-8c08-f538dba597ca tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] 10.222.0.27 "GET /compute/v2.1/servers/f024434a-d44b-41f9-8818-da15a5d0a52d" status: 200 len: 1319 microversion: 2.1 time: 0.158403 Sep 20 04:54:32.565790 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 135/272] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:32 2022] GET /compute/v2.1/servers/f024434a-d44b-41f9-8818-da15a5d0a52d => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:54:32.671417 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-fd4434d4-06d6-425c-b58d-8ef06f85bb2f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:32.672058 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-fd4434d4-06d6-425c-b58d-8ef06f85bb2f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:32.678435 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fd4434d4-06d6-425c-b58d-8ef06f85bb2f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:32.678912 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fd4434d4-06d6-425c-b58d-8ef06f85bb2f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:32.679344 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fd4434d4-06d6-425c-b58d-8ef06f85bb2f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:32.680019 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fd4434d4-06d6-425c-b58d-8ef06f85bb2f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:32.680466 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fd4434d4-06d6-425c-b58d-8ef06f85bb2f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:32.680911 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fd4434d4-06d6-425c-b58d-8ef06f85bb2f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:32.742257 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-fd4434d4-06d6-425c-b58d-8ef06f85bb2f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:32.750340 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-fd4434d4-06d6-425c-b58d-8ef06f85bb2f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906" status: 200 len: 1241 microversion: 2.1 time: 0.082852 Sep 20 04:54:32.750917 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 138/273] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:32 2022] GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906 => generated 1241 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:54:33.350694 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-06a55f92-0cec-4821-b9a9-01919e9cff4a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:33.351392 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-06a55f92-0cec-4821-b9a9-01919e9cff4a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 60372fad-5a9d-4d04-89e4-8aca10601222] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:33.357476 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-06a55f92-0cec-4821-b9a9-01919e9cff4a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:33.357964 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-06a55f92-0cec-4821-b9a9-01919e9cff4a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:33.358437 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-06a55f92-0cec-4821-b9a9-01919e9cff4a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:33.359137 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-06a55f92-0cec-4821-b9a9-01919e9cff4a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:33.359588 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-06a55f92-0cec-4821-b9a9-01919e9cff4a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:33.360015 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-06a55f92-0cec-4821-b9a9-01919e9cff4a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:33.493449 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-06a55f92-0cec-4821-b9a9-01919e9cff4a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:33.501823 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-06a55f92-0cec-4821-b9a9-01919e9cff4a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222" status: 200 len: 1367 microversion: 2.1 time: 0.155682 Sep 20 04:54:33.502515 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 136/274] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:33 2022] GET /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:54:33.591995 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-beaa9528-89cd-486b-9f3b-a6abfc326996 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:33.592759 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-beaa9528-89cd-486b-9f3b-a6abfc326996 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] [instance: f024434a-d44b-41f9-8818-da15a5d0a52d] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:33.599890 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-beaa9528-89cd-486b-9f3b-a6abfc326996 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:33.600583 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-beaa9528-89cd-486b-9f3b-a6abfc326996 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:33.601215 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-beaa9528-89cd-486b-9f3b-a6abfc326996 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:33.602002 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-beaa9528-89cd-486b-9f3b-a6abfc326996 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:33.602515 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-beaa9528-89cd-486b-9f3b-a6abfc326996 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:33.602999 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-beaa9528-89cd-486b-9f3b-a6abfc326996 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:33.740996 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-beaa9528-89cd-486b-9f3b-a6abfc326996 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d877f0c71f4e18854813780214ed6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725d386301d648de85fd6c4767250c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:33.748547 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-beaa9528-89cd-486b-9f3b-a6abfc326996 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] 10.222.0.27 "GET /compute/v2.1/servers/f024434a-d44b-41f9-8818-da15a5d0a52d" status: 200 len: 1319 microversion: 2.1 time: 0.161958 Sep 20 04:54:33.749159 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 139/275] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:33 2022] GET /compute/v2.1/servers/f024434a-d44b-41f9-8818-da15a5d0a52d => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:54:33.774195 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-81edc88b-068c-4ec0-aa4f-a9b01189cb8b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:33.774882 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-81edc88b-068c-4ec0-aa4f-a9b01189cb8b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:33.781232 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-81edc88b-068c-4ec0-aa4f-a9b01189cb8b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:33.781739 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-81edc88b-068c-4ec0-aa4f-a9b01189cb8b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:33.782171 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-81edc88b-068c-4ec0-aa4f-a9b01189cb8b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:33.782905 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-81edc88b-068c-4ec0-aa4f-a9b01189cb8b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:33.783349 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-81edc88b-068c-4ec0-aa4f-a9b01189cb8b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:33.783766 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-81edc88b-068c-4ec0-aa4f-a9b01189cb8b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:33.850261 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-81edc88b-068c-4ec0-aa4f-a9b01189cb8b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:33.859427 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-81edc88b-068c-4ec0-aa4f-a9b01189cb8b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906" status: 200 len: 1297 microversion: 2.1 time: 0.089443 Sep 20 04:54:33.860137 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 137/276] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:33 2022] GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906 => generated 1297 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:54:34.530910 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-f9614743-3f11-4ca7-824a-9fca013f7df3 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:34.533632 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-f9614743-3f11-4ca7-824a-9fca013f7df3 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 60372fad-5a9d-4d04-89e4-8aca10601222] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:34.546034 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f9614743-3f11-4ca7-824a-9fca013f7df3 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:34.546643 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f9614743-3f11-4ca7-824a-9fca013f7df3 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:34.547185 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f9614743-3f11-4ca7-824a-9fca013f7df3 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:34.548280 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f9614743-3f11-4ca7-824a-9fca013f7df3 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:34.549201 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f9614743-3f11-4ca7-824a-9fca013f7df3 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:34.549956 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f9614743-3f11-4ca7-824a-9fca013f7df3 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:34.772076 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-fb94b5b1-1a96-4966-8e11-089f5e03ac68 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:34.773288 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-fb94b5b1-1a96-4966-8e11-089f5e03ac68 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] [instance: f024434a-d44b-41f9-8818-da15a5d0a52d] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:34.780378 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-fb94b5b1-1a96-4966-8e11-089f5e03ac68 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:34.781873 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-fb94b5b1-1a96-4966-8e11-089f5e03ac68 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:34.782538 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-fb94b5b1-1a96-4966-8e11-089f5e03ac68 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:34.783681 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-fb94b5b1-1a96-4966-8e11-089f5e03ac68 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:34.784145 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-fb94b5b1-1a96-4966-8e11-089f5e03ac68 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:34.784656 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-fb94b5b1-1a96-4966-8e11-089f5e03ac68 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:34.808211 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-f9614743-3f11-4ca7-824a-9fca013f7df3 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:34.823484 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-f9614743-3f11-4ca7-824a-9fca013f7df3 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222" status: 200 len: 1558 microversion: 2.1 time: 0.300280 Sep 20 04:54:34.825141 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 140/277] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:34 2022] GET /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222 => generated 1558 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:54:34.849142 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-303a8a16-fa10-45fe-97a9-e406b0a9458f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:34.849888 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-303a8a16-fa10-45fe-97a9-e406b0a9458f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 60372fad-5a9d-4d04-89e4-8aca10601222] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:34.856005 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-303a8a16-fa10-45fe-97a9-e406b0a9458f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:34.856565 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-303a8a16-fa10-45fe-97a9-e406b0a9458f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:34.857044 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-303a8a16-fa10-45fe-97a9-e406b0a9458f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:34.857732 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-303a8a16-fa10-45fe-97a9-e406b0a9458f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:34.858185 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-303a8a16-fa10-45fe-97a9-e406b0a9458f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:34.858610 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-303a8a16-fa10-45fe-97a9-e406b0a9458f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:34.992376 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-303a8a16-fa10-45fe-97a9-e406b0a9458f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.147193 Sep 20 04:54:34.993018 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 141/278] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Sep 20 04:54:34 2022] GET /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222/os-interface => generated 285 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:54:34.998267 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-5dd98fd1-f401-4954-8a9b-a1cb4a40f37a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:34.998866 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-5dd98fd1-f401-4954-8a9b-a1cb4a40f37a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:35.009868 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5dd98fd1-f401-4954-8a9b-a1cb4a40f37a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:35.010358 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5dd98fd1-f401-4954-8a9b-a1cb4a40f37a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:35.010795 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5dd98fd1-f401-4954-8a9b-a1cb4a40f37a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:35.011497 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5dd98fd1-f401-4954-8a9b-a1cb4a40f37a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:35.012151 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5dd98fd1-f401-4954-8a9b-a1cb4a40f37a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:35.012736 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5dd98fd1-f401-4954-8a9b-a1cb4a40f37a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:35.030753 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-fb94b5b1-1a96-4966-8e11-089f5e03ac68 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d877f0c71f4e18854813780214ed6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725d386301d648de85fd6c4767250c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:35.044965 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-fb94b5b1-1a96-4966-8e11-089f5e03ac68 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] 10.222.0.27 "GET /compute/v2.1/servers/f024434a-d44b-41f9-8818-da15a5d0a52d" status: 200 len: 1319 microversion: 2.1 time: 0.277357 Sep 20 04:54:35.046451 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 138/279] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:34 2022] GET /compute/v2.1/servers/f024434a-d44b-41f9-8818-da15a5d0a52d => generated 1319 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:54:35.116702 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-5dd98fd1-f401-4954-8a9b-a1cb4a40f37a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:35.127791 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-5dd98fd1-f401-4954-8a9b-a1cb4a40f37a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906" status: 200 len: 1303 microversion: 2.1 time: 0.133475 Sep 20 04:54:35.131343 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 142/280] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:34 2022] GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906 => generated 1303 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:54:36.070669 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-be0e18a4-ae70-4489-849f-3fc5f9f496b9 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:36.071920 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-be0e18a4-ae70-4489-849f-3fc5f9f496b9 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] [instance: f024434a-d44b-41f9-8818-da15a5d0a52d] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:36.078901 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-be0e18a4-ae70-4489-849f-3fc5f9f496b9 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:36.079379 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-be0e18a4-ae70-4489-849f-3fc5f9f496b9 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:36.080047 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-be0e18a4-ae70-4489-849f-3fc5f9f496b9 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:36.080945 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-be0e18a4-ae70-4489-849f-3fc5f9f496b9 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:36.082010 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-be0e18a4-ae70-4489-849f-3fc5f9f496b9 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:36.082638 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-be0e18a4-ae70-4489-849f-3fc5f9f496b9 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:36.163237 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-89aec5fa-0938-407b-91bb-78b878829a95 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:36.163867 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-89aec5fa-0938-407b-91bb-78b878829a95 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:36.170469 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-89aec5fa-0938-407b-91bb-78b878829a95 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:36.171165 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-89aec5fa-0938-407b-91bb-78b878829a95 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:36.171818 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-89aec5fa-0938-407b-91bb-78b878829a95 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:36.172529 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-89aec5fa-0938-407b-91bb-78b878829a95 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:36.173021 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-89aec5fa-0938-407b-91bb-78b878829a95 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:36.173451 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-89aec5fa-0938-407b-91bb-78b878829a95 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:36.347147 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-be0e18a4-ae70-4489-849f-3fc5f9f496b9 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d877f0c71f4e18854813780214ed6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725d386301d648de85fd6c4767250c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:36.355043 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-be0e18a4-ae70-4489-849f-3fc5f9f496b9 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] 10.222.0.27 "GET /compute/v2.1/servers/f024434a-d44b-41f9-8818-da15a5d0a52d" status: 200 len: 1319 microversion: 2.1 time: 0.289025 Sep 20 04:54:36.355980 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 139/281] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:36 2022] GET /compute/v2.1/servers/f024434a-d44b-41f9-8818-da15a5d0a52d => generated 1319 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:54:36.360868 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [req-142e7da1-05fa-4f0e-9d59-51609f97c8f6 req-2cb73bcd-aff2-4a83-a82b-da1da2c88390 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60372fad-5a9d-4d04-89e4-8aca10601222", "tag": "9143766c-b4ab-434b-8c53-ed214e20f104"}]} {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:54:36.371059 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [req-142e7da1-05fa-4f0e-9d59-51609f97c8f6 req-2cb73bcd-aff2-4a83-a82b-da1da2c88390 service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:36.372164 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [req-142e7da1-05fa-4f0e-9d59-51609f97c8f6 req-2cb73bcd-aff2-4a83-a82b-da1da2c88390 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:36.372959 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [req-142e7da1-05fa-4f0e-9d59-51609f97c8f6 req-2cb73bcd-aff2-4a83-a82b-da1da2c88390 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:36.385974 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.compute.server_external_events [req-142e7da1-05fa-4f0e-9d59-51609f97c8f6 req-2cb73bcd-aff2-4a83-a82b-da1da2c88390 service nova] Creating event network-changed:9143766c-b4ab-434b-8c53-ed214e20f104 for instance 60372fad-5a9d-4d04-89e4-8aca10601222 on hv-cinder-75671 Sep 20 04:54:36.391918 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [req-142e7da1-05fa-4f0e-9d59-51609f97c8f6 req-2cb73bcd-aff2-4a83-a82b-da1da2c88390 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034293 Sep 20 04:54:36.398487 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 140/282] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 04:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:54:36.433563 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [req-5096d06a-c8d8-414f-95ae-d40ae97ba217 req-72f22d62-e5cc-4704-9cc4-e7d4f0c0207e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8df00208-8207-4ff8-9979-2e00926de906", "tag": "0d0b44d0-2172-48f9-b9c5-88e71d3e7975"}]} {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:54:36.436130 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-89aec5fa-0938-407b-91bb-78b878829a95 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:36.445524 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [req-5096d06a-c8d8-414f-95ae-d40ae97ba217 req-72f22d62-e5cc-4704-9cc4-e7d4f0c0207e service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:36.446239 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [req-5096d06a-c8d8-414f-95ae-d40ae97ba217 req-72f22d62-e5cc-4704-9cc4-e7d4f0c0207e service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:36.446956 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [req-5096d06a-c8d8-414f-95ae-d40ae97ba217 req-72f22d62-e5cc-4704-9cc4-e7d4f0c0207e service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:36.451331 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-89aec5fa-0938-407b-91bb-78b878829a95 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906" status: 200 len: 1370 microversion: 2.1 time: 0.294261 Sep 20 04:54:36.452102 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 143/283] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:36 2022] GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906 => generated 1370 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:54:36.467593 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.compute.server_external_events [req-5096d06a-c8d8-414f-95ae-d40ae97ba217 req-72f22d62-e5cc-4704-9cc4-e7d4f0c0207e service nova] Creating event network-changed:0d0b44d0-2172-48f9-b9c5-88e71d3e7975 for instance 8df00208-8207-4ff8-9979-2e00926de906 on hv-cinder-75671 Sep 20 04:54:36.472285 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [req-5096d06a-c8d8-414f-95ae-d40ae97ba217 req-72f22d62-e5cc-4704-9cc4-e7d4f0c0207e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042776 Sep 20 04:54:36.473695 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 141/284] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 04:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:54:36.896623 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-f50dbb89-beee-4d51-ac68-e68a4672bd2f req-56b73a32-2b1b-4fef-a877-47114819f193 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f024434a-d44b-41f9-8818-da15a5d0a52d", "name": "network-vif-plugged", "status": "completed", "tag": "d063bff7-96f4-43ab-aeaf-6b6e6cab44e0"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:54:36.909102 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-f50dbb89-beee-4d51-ac68-e68a4672bd2f req-56b73a32-2b1b-4fef-a877-47114819f193 service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:36.910368 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-f50dbb89-beee-4d51-ac68-e68a4672bd2f req-56b73a32-2b1b-4fef-a877-47114819f193 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:36.910988 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-f50dbb89-beee-4d51-ac68-e68a4672bd2f req-56b73a32-2b1b-4fef-a877-47114819f193 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:36.924302 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-f50dbb89-beee-4d51-ac68-e68a4672bd2f req-56b73a32-2b1b-4fef-a877-47114819f193 service nova] Creating event network-vif-plugged:d063bff7-96f4-43ab-aeaf-6b6e6cab44e0 for instance f024434a-d44b-41f9-8818-da15a5d0a52d on hv-cinder-75671 Sep 20 04:54:36.932464 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-f50dbb89-beee-4d51-ac68-e68a4672bd2f req-56b73a32-2b1b-4fef-a877-47114819f193 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042239 Sep 20 04:54:36.933383 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 144/285] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 04:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:54:37.384446 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-5d750a60-27fd-42cf-9881-f42b8f0047eb tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:37.385213 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-5d750a60-27fd-42cf-9881-f42b8f0047eb tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] [instance: f024434a-d44b-41f9-8818-da15a5d0a52d] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:37.392781 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-5d750a60-27fd-42cf-9881-f42b8f0047eb tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:37.393338 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-5d750a60-27fd-42cf-9881-f42b8f0047eb tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:37.394406 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-5d750a60-27fd-42cf-9881-f42b8f0047eb tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:37.395283 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-5d750a60-27fd-42cf-9881-f42b8f0047eb tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:37.395743 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-5d750a60-27fd-42cf-9881-f42b8f0047eb tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:37.396260 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-5d750a60-27fd-42cf-9881-f42b8f0047eb tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:37.482729 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-d051abc2-7415-4eda-9fe2-376ab6fa3c29 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:37.484513 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-d051abc2-7415-4eda-9fe2-376ab6fa3c29 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:37.495433 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d051abc2-7415-4eda-9fe2-376ab6fa3c29 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:37.496198 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d051abc2-7415-4eda-9fe2-376ab6fa3c29 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:37.496745 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d051abc2-7415-4eda-9fe2-376ab6fa3c29 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:37.497670 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d051abc2-7415-4eda-9fe2-376ab6fa3c29 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:37.498333 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d051abc2-7415-4eda-9fe2-376ab6fa3c29 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:37.498975 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d051abc2-7415-4eda-9fe2-376ab6fa3c29 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:37.565047 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-5d750a60-27fd-42cf-9881-f42b8f0047eb tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d877f0c71f4e18854813780214ed6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725d386301d648de85fd6c4767250c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:37.573601 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-5d750a60-27fd-42cf-9881-f42b8f0047eb tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] 10.222.0.27 "GET /compute/v2.1/servers/f024434a-d44b-41f9-8818-da15a5d0a52d" status: 200 len: 1319 microversion: 2.1 time: 0.193794 Sep 20 04:54:37.574182 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 142/286] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:37 2022] GET /compute/v2.1/servers/f024434a-d44b-41f9-8818-da15a5d0a52d => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:54:37.666171 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-d051abc2-7415-4eda-9fe2-376ab6fa3c29 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:37.676520 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-d051abc2-7415-4eda-9fe2-376ab6fa3c29 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906" status: 200 len: 1370 microversion: 2.1 time: 0.200052 Sep 20 04:54:37.677220 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 145/287] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:37 2022] GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906 => generated 1370 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:54:38.596696 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-daba3ecf-b9f9-4256-bb0b-8b2c8bb04d2b tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:38.597844 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-daba3ecf-b9f9-4256-bb0b-8b2c8bb04d2b tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] [instance: f024434a-d44b-41f9-8818-da15a5d0a52d] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:38.604230 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-daba3ecf-b9f9-4256-bb0b-8b2c8bb04d2b tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:38.604738 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-daba3ecf-b9f9-4256-bb0b-8b2c8bb04d2b tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:38.605171 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-daba3ecf-b9f9-4256-bb0b-8b2c8bb04d2b tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:38.605852 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-daba3ecf-b9f9-4256-bb0b-8b2c8bb04d2b tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:38.606318 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-daba3ecf-b9f9-4256-bb0b-8b2c8bb04d2b tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:38.606737 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-daba3ecf-b9f9-4256-bb0b-8b2c8bb04d2b tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:38.700136 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-e38aebdb-e45b-4ff3-97c5-d3292921be02 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:38.701572 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-e38aebdb-e45b-4ff3-97c5-d3292921be02 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:38.711039 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e38aebdb-e45b-4ff3-97c5-d3292921be02 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:38.711752 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e38aebdb-e45b-4ff3-97c5-d3292921be02 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:38.712223 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e38aebdb-e45b-4ff3-97c5-d3292921be02 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:38.713259 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e38aebdb-e45b-4ff3-97c5-d3292921be02 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:38.713897 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e38aebdb-e45b-4ff3-97c5-d3292921be02 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:38.714520 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e38aebdb-e45b-4ff3-97c5-d3292921be02 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:38.749335 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-daba3ecf-b9f9-4256-bb0b-8b2c8bb04d2b tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d877f0c71f4e18854813780214ed6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725d386301d648de85fd6c4767250c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:38.757806 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-daba3ecf-b9f9-4256-bb0b-8b2c8bb04d2b tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] 10.222.0.27 "GET /compute/v2.1/servers/f024434a-d44b-41f9-8818-da15a5d0a52d" status: 200 len: 1319 microversion: 2.1 time: 0.164816 Sep 20 04:54:38.758512 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 143/288] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:38 2022] GET /compute/v2.1/servers/f024434a-d44b-41f9-8818-da15a5d0a52d => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:54:38.997508 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-e38aebdb-e45b-4ff3-97c5-d3292921be02 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:39.006679 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-e38aebdb-e45b-4ff3-97c5-d3292921be02 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906" status: 200 len: 1370 microversion: 2.1 time: 0.310912 Sep 20 04:54:39.007560 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 146/289] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:38 2022] GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906 => generated 1370 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:54:39.781283 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-85fbb646-7bea-4f43-8481-3cef1ddae9ee tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:39.781919 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-85fbb646-7bea-4f43-8481-3cef1ddae9ee tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] [instance: f024434a-d44b-41f9-8818-da15a5d0a52d] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:39.788998 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-85fbb646-7bea-4f43-8481-3cef1ddae9ee tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:39.789472 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-85fbb646-7bea-4f43-8481-3cef1ddae9ee tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:39.789900 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-85fbb646-7bea-4f43-8481-3cef1ddae9ee tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:39.790573 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-85fbb646-7bea-4f43-8481-3cef1ddae9ee tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:39.791018 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-85fbb646-7bea-4f43-8481-3cef1ddae9ee tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:39.791461 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-85fbb646-7bea-4f43-8481-3cef1ddae9ee tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:39.927381 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-85fbb646-7bea-4f43-8481-3cef1ddae9ee tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d877f0c71f4e18854813780214ed6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725d386301d648de85fd6c4767250c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:39.935232 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-85fbb646-7bea-4f43-8481-3cef1ddae9ee tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] 10.222.0.27 "GET /compute/v2.1/servers/f024434a-d44b-41f9-8818-da15a5d0a52d" status: 200 len: 1508 microversion: 2.1 time: 0.157861 Sep 20 04:54:39.935797 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 144/290] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:39 2022] GET /compute/v2.1/servers/f024434a-d44b-41f9-8818-da15a5d0a52d => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:54:40.029748 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-795b04af-7d07-4ede-b13b-1e3f0c9a5450 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:40.030353 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-795b04af-7d07-4ede-b13b-1e3f0c9a5450 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:40.037630 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-795b04af-7d07-4ede-b13b-1e3f0c9a5450 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:40.038116 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-795b04af-7d07-4ede-b13b-1e3f0c9a5450 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:40.038549 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-795b04af-7d07-4ede-b13b-1e3f0c9a5450 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:40.039236 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-795b04af-7d07-4ede-b13b-1e3f0c9a5450 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:40.039693 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-795b04af-7d07-4ede-b13b-1e3f0c9a5450 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:40.040128 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-795b04af-7d07-4ede-b13b-1e3f0c9a5450 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:40.174574 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-795b04af-7d07-4ede-b13b-1e3f0c9a5450 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:40.182766 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-795b04af-7d07-4ede-b13b-1e3f0c9a5450 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906" status: 200 len: 1370 microversion: 2.1 time: 0.156844 Sep 20 04:54:40.183309 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 147/291] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:40 2022] GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906 => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:54:41.204160 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-103705d0-acb3-4d52-a531-dc11458281e3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:41.204794 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-103705d0-acb3-4d52-a531-dc11458281e3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:41.211732 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-103705d0-acb3-4d52-a531-dc11458281e3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:41.212209 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-103705d0-acb3-4d52-a531-dc11458281e3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:41.212672 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-103705d0-acb3-4d52-a531-dc11458281e3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:41.213354 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-103705d0-acb3-4d52-a531-dc11458281e3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:41.213798 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-103705d0-acb3-4d52-a531-dc11458281e3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:41.214216 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-103705d0-acb3-4d52-a531-dc11458281e3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:41.218174 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG dbcounter [-] [126814] Writing DB stats nova_cell1:SELECT=100 {{(pid=126814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:54:41.340570 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-103705d0-acb3-4d52-a531-dc11458281e3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:41.348139 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-103705d0-acb3-4d52-a531-dc11458281e3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906" status: 200 len: 1370 microversion: 2.1 time: 0.147814 Sep 20 04:54:41.348716 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 145/292] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:41 2022] GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906 => generated 1370 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:54:42.370374 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-9c6a9e28-ca07-43ba-9e82-9915bd47d2c6 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:42.370983 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-9c6a9e28-ca07-43ba-9e82-9915bd47d2c6 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:42.373503 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell0:SELECT=2 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:54:42.374157 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell0:SELECT=6 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:54:42.380404 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9c6a9e28-ca07-43ba-9e82-9915bd47d2c6 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:42.380913 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9c6a9e28-ca07-43ba-9e82-9915bd47d2c6 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:42.381355 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9c6a9e28-ca07-43ba-9e82-9915bd47d2c6 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:42.382035 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9c6a9e28-ca07-43ba-9e82-9915bd47d2c6 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:42.382492 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9c6a9e28-ca07-43ba-9e82-9915bd47d2c6 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:42.382912 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9c6a9e28-ca07-43ba-9e82-9915bd47d2c6 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:42.507398 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-9c6a9e28-ca07-43ba-9e82-9915bd47d2c6 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:42.514981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-9c6a9e28-ca07-43ba-9e82-9915bd47d2c6 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906" status: 200 len: 1370 microversion: 2.1 time: 0.148468 Sep 20 04:54:42.515537 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 148/293] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:42 2022] GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906 => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:54:43.538622 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-863571f2-f9d2-4e6b-be65-0b1b00041c08 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:43.539222 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-863571f2-f9d2-4e6b-be65-0b1b00041c08 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:43.541077 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG dbcounter [-] [126814] Writing DB stats nova_cell0:SELECT=2 {{(pid=126814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:54:43.546691 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-863571f2-f9d2-4e6b-be65-0b1b00041c08 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:43.547169 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-863571f2-f9d2-4e6b-be65-0b1b00041c08 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:43.547602 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-863571f2-f9d2-4e6b-be65-0b1b00041c08 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:43.548278 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-863571f2-f9d2-4e6b-be65-0b1b00041c08 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:43.548761 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-863571f2-f9d2-4e6b-be65-0b1b00041c08 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:43.549186 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-863571f2-f9d2-4e6b-be65-0b1b00041c08 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:43.690321 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-863571f2-f9d2-4e6b-be65-0b1b00041c08 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:43.698528 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-863571f2-f9d2-4e6b-be65-0b1b00041c08 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906" status: 200 len: 1370 microversion: 2.1 time: 0.164325 Sep 20 04:54:43.699300 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 146/294] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:43 2022] GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906 => generated 1370 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:54:44.727949 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-9c74685d-1d2b-4561-8dc3-cd78c85a0a10 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:44.728555 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-9c74685d-1d2b-4561-8dc3-cd78c85a0a10 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:44.735025 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9c74685d-1d2b-4561-8dc3-cd78c85a0a10 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:44.735499 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9c74685d-1d2b-4561-8dc3-cd78c85a0a10 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:44.735930 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9c74685d-1d2b-4561-8dc3-cd78c85a0a10 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:44.736618 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9c74685d-1d2b-4561-8dc3-cd78c85a0a10 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:44.737594 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9c74685d-1d2b-4561-8dc3-cd78c85a0a10 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:44.738007 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9c74685d-1d2b-4561-8dc3-cd78c85a0a10 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:44.886394 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-9c74685d-1d2b-4561-8dc3-cd78c85a0a10 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:44.895673 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-9c74685d-1d2b-4561-8dc3-cd78c85a0a10 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906" status: 200 len: 1370 microversion: 2.1 time: 0.171450 Sep 20 04:54:44.896230 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 149/295] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:44 2022] GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906 => generated 1370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:54:45.918777 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-65b21f07-f947-47ba-80fe-f7188180a6c4 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:45.919460 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-65b21f07-f947-47ba-80fe-f7188180a6c4 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:45.925980 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-65b21f07-f947-47ba-80fe-f7188180a6c4 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:45.926466 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-65b21f07-f947-47ba-80fe-f7188180a6c4 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:45.926898 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-65b21f07-f947-47ba-80fe-f7188180a6c4 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:45.927596 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-65b21f07-f947-47ba-80fe-f7188180a6c4 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:45.928044 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-65b21f07-f947-47ba-80fe-f7188180a6c4 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:45.928462 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-65b21f07-f947-47ba-80fe-f7188180a6c4 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:46.075158 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-65b21f07-f947-47ba-80fe-f7188180a6c4 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:46.083528 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-65b21f07-f947-47ba-80fe-f7188180a6c4 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906" status: 200 len: 1370 microversion: 2.1 time: 0.168870 Sep 20 04:54:46.084090 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 147/296] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:45 2022] GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906 => generated 1370 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:54:47.106324 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-d44024c9-924f-4e4d-9002-aee116c8ccfa tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:47.106940 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-d44024c9-924f-4e4d-9002-aee116c8ccfa tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:47.115519 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d44024c9-924f-4e4d-9002-aee116c8ccfa tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:47.116019 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d44024c9-924f-4e4d-9002-aee116c8ccfa tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:47.116463 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d44024c9-924f-4e4d-9002-aee116c8ccfa tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:47.117194 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d44024c9-924f-4e4d-9002-aee116c8ccfa tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:47.117654 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d44024c9-924f-4e4d-9002-aee116c8ccfa tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:47.118092 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d44024c9-924f-4e4d-9002-aee116c8ccfa tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:47.273458 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-d44024c9-924f-4e4d-9002-aee116c8ccfa tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:47.282615 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-d44024c9-924f-4e4d-9002-aee116c8ccfa tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906" status: 200 len: 1370 microversion: 2.1 time: 0.180150 Sep 20 04:54:47.283187 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 150/297] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:47 2022] GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906 => generated 1370 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:54:48.307861 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-345ee45d-5d1a-4085-9af9-1947ae876e4e tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:48.308419 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-345ee45d-5d1a-4085-9af9-1947ae876e4e tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:48.315920 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-345ee45d-5d1a-4085-9af9-1947ae876e4e tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:48.316407 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-345ee45d-5d1a-4085-9af9-1947ae876e4e tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:48.316876 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-345ee45d-5d1a-4085-9af9-1947ae876e4e tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:48.317577 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-345ee45d-5d1a-4085-9af9-1947ae876e4e tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:48.318030 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-345ee45d-5d1a-4085-9af9-1947ae876e4e tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:48.318453 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-345ee45d-5d1a-4085-9af9-1947ae876e4e tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:48.465615 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-345ee45d-5d1a-4085-9af9-1947ae876e4e tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:48.474001 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-345ee45d-5d1a-4085-9af9-1947ae876e4e tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906" status: 200 len: 1370 microversion: 2.1 time: 0.170339 Sep 20 04:54:48.474578 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 148/298] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:48 2022] GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906 => generated 1370 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:54:48.739948 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-6c376491-dc52-48b8-8399-47f7db189b5a req-c9bede05-e564-4a67-8a6f-b9983e0cb98a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8df00208-8207-4ff8-9979-2e00926de906", "name": "network-vif-plugged", "status": "completed", "tag": "0d0b44d0-2172-48f9-b9c5-88e71d3e7975"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:54:48.754249 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-6c376491-dc52-48b8-8399-47f7db189b5a req-c9bede05-e564-4a67-8a6f-b9983e0cb98a service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:48.754725 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-6c376491-dc52-48b8-8399-47f7db189b5a req-c9bede05-e564-4a67-8a6f-b9983e0cb98a service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:48.755176 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-6c376491-dc52-48b8-8399-47f7db189b5a req-c9bede05-e564-4a67-8a6f-b9983e0cb98a service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:48.769047 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-6c376491-dc52-48b8-8399-47f7db189b5a req-c9bede05-e564-4a67-8a6f-b9983e0cb98a service nova] Creating event network-vif-plugged:0d0b44d0-2172-48f9-b9c5-88e71d3e7975 for instance 8df00208-8207-4ff8-9979-2e00926de906 on hv-cinder-75671 Sep 20 04:54:48.775423 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-6c376491-dc52-48b8-8399-47f7db189b5a req-c9bede05-e564-4a67-8a6f-b9983e0cb98a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040548 Sep 20 04:54:48.776485 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 151/299] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 04:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:54:49.505840 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-3e12e9d0-3b62-431b-a0c0-dbea49733c22 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:49.506424 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-3e12e9d0-3b62-431b-a0c0-dbea49733c22 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:49.512865 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-3e12e9d0-3b62-431b-a0c0-dbea49733c22 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:49.513340 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-3e12e9d0-3b62-431b-a0c0-dbea49733c22 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:49.513768 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-3e12e9d0-3b62-431b-a0c0-dbea49733c22 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:49.514444 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-3e12e9d0-3b62-431b-a0c0-dbea49733c22 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:49.514887 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-3e12e9d0-3b62-431b-a0c0-dbea49733c22 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:49.515306 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-3e12e9d0-3b62-431b-a0c0-dbea49733c22 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:49.649283 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.policy [None req-3e12e9d0-3b62-431b-a0c0-dbea49733c22 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126814) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:49.657054 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-3e12e9d0-3b62-431b-a0c0-dbea49733c22 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906" status: 200 len: 1370 microversion: 2.1 time: 0.155209 Sep 20 04:54:49.657613 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 149/300] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:49 2022] GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:54:50.683454 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-16435a67-2eeb-44ab-823a-ee22ac74010a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:50.684140 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-16435a67-2eeb-44ab-823a-ee22ac74010a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:50.686085 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=6 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:54:50.691432 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-16435a67-2eeb-44ab-823a-ee22ac74010a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:50.691901 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-16435a67-2eeb-44ab-823a-ee22ac74010a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:50.692329 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-16435a67-2eeb-44ab-823a-ee22ac74010a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:50.693036 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-16435a67-2eeb-44ab-823a-ee22ac74010a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:50.693488 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-16435a67-2eeb-44ab-823a-ee22ac74010a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:50.693903 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-16435a67-2eeb-44ab-823a-ee22ac74010a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:50.698566 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell1:SELECT=96 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:54:50.827872 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-16435a67-2eeb-44ab-823a-ee22ac74010a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:54:50.836103 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-16435a67-2eeb-44ab-823a-ee22ac74010a tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906" status: 200 len: 1565 microversion: 2.1 time: 0.157367 Sep 20 04:54:50.836686 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 152/301] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:54:50 2022] GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906 => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:54:50.859156 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-3f19f938-3979-40d0-9e0e-cc87ca6f6ef8 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:54:50.859974 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.compute.api [None req-3f19f938-3979-40d0-9e0e-cc87ca6f6ef8 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126814) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:54:50.862194 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG dbcounter [-] [126814] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=1 {{(pid=126814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:54:50.868097 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-3f19f938-3979-40d0-9e0e-cc87ca6f6ef8 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:50.868585 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-3f19f938-3979-40d0-9e0e-cc87ca6f6ef8 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:50.869043 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-3f19f938-3979-40d0-9e0e-cc87ca6f6ef8 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:50.869773 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-3f19f938-3979-40d0-9e0e-cc87ca6f6ef8 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:50.870221 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-3f19f938-3979-40d0-9e0e-cc87ca6f6ef8 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:50.870643 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG oslo_concurrency.lockutils [None req-3f19f938-3979-40d0-9e0e-cc87ca6f6ef8 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:50.949054 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-3f19f938-3979-40d0-9e0e-cc87ca6f6ef8 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093905 Sep 20 04:54:50.949660 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 150/302] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Sep 20 04:54:50 2022] GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:54:52.365163 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-fef4d750-8ad2-448b-ad81-a440fc39d5b5 req-00f9c5a3-7d02-44fd-8e35-572aa465acdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8df00208-8207-4ff8-9979-2e00926de906", "tag": "0d0b44d0-2172-48f9-b9c5-88e71d3e7975"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:54:52.375742 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-fef4d750-8ad2-448b-ad81-a440fc39d5b5 req-00f9c5a3-7d02-44fd-8e35-572aa465acdf service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:54:52.376377 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-fef4d750-8ad2-448b-ad81-a440fc39d5b5 req-00f9c5a3-7d02-44fd-8e35-572aa465acdf service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:54:52.377094 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-fef4d750-8ad2-448b-ad81-a440fc39d5b5 req-00f9c5a3-7d02-44fd-8e35-572aa465acdf service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:54:52.389827 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-fef4d750-8ad2-448b-ad81-a440fc39d5b5 req-00f9c5a3-7d02-44fd-8e35-572aa465acdf service nova] Creating event network-changed:0d0b44d0-2172-48f9-b9c5-88e71d3e7975 for instance 8df00208-8207-4ff8-9979-2e00926de906 on hv-cinder-75671 Sep 20 04:54:52.398266 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-fef4d750-8ad2-448b-ad81-a440fc39d5b5 req-00f9c5a3-7d02-44fd-8e35-572aa465acdf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036772 Sep 20 04:54:52.399134 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 153/303] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 04:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:54:59.753684 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-587c3dda-b90e-4d73-9f6d-d4c4f7cca5a9 tempest-TestShelveInstance-175665765 tempest-TestShelveInstance-175665765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1236240893", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1643038489", "security_groups": [{"name": "tempest-secgroup-smoke-47953344"}], "networks": [{"uuid": "7270c520-c796-4eb7-8e5a-1cb3d55ddcbf"}], "block_device_mapping_v2": [{"uuid": "917367a6-7e2a-4c1d-af5f-d3924bd6f82a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=126814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:55:00.889408 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG dbcounter [-] [126814] Writing DB stats nova_cell1:SELECT=33 {{(pid=126814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:55:06.127672 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-f9abb253-2b2a-4f48-a3eb-d24c3967b48a tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03bb41d8-d802-4472-97a9-ad38d40b5fed", "device": "/dev/sdb"}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:55:06.131291 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-f9abb253-2b2a-4f48-a3eb-d24c3967b48a tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] [instance: f024434a-d44b-41f9-8818-da15a5d0a52d] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:06.136477 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_api:SELECT=3 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:55:06.137195 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell1:SELECT=7 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:55:06.139407 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f9abb253-2b2a-4f48-a3eb-d24c3967b48a tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:06.139670 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f9abb253-2b2a-4f48-a3eb-d24c3967b48a tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:06.140386 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f9abb253-2b2a-4f48-a3eb-d24c3967b48a tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:06.141114 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f9abb253-2b2a-4f48-a3eb-d24c3967b48a tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:06.141566 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f9abb253-2b2a-4f48-a3eb-d24c3967b48a tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:06.141995 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f9abb253-2b2a-4f48-a3eb-d24c3967b48a tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:06.423261 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-f9abb253-2b2a-4f48-a3eb-d24c3967b48a tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] 10.222.0.27 "POST /compute/v2.1/servers/f024434a-d44b-41f9-8818-da15a5d0a52d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299645 Sep 20 04:55:06.424366 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 154/304] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Sep 20 04:55:06 2022] POST /compute/v2.1/servers/f024434a-d44b-41f9-8818-da15a5d0a52d/os-volume_attachments => generated 194 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:55:09.766034 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG dbcounter [-] [126814] Writing DB stats nova_api:SELECT=3 {{(pid=126814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:55:10.002005 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-1e4a1ba5-4d51-4bb1-b773-8d6e77bdf687 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-99432251", "imageRef": "080ea053-830e-4470-a886-0ab99b0ab3e0", "flavorRef": "452"}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:55:10.053547 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.network.neutron [None req-1e4a1ba5-4d51-4bb1-b773-8d6e77bdf687 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] validate_networks() for None {{(pid=126813) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 20 04:55:10.327981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-1e4a1ba5-4d51-4bb1-b773-8d6e77bdf687 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Flavor limits 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 20 04:55:10.328398 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-1e4a1ba5-4d51-4bb1-b773-8d6e77bdf687 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Image limits 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 20 04:55:10.328906 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-1e4a1ba5-4d51-4bb1-b773-8d6e77bdf687 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Flavor pref 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 20 04:55:10.329314 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-1e4a1ba5-4d51-4bb1-b773-8d6e77bdf687 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Image pref 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 20 04:55:10.330208 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-1e4a1ba5-4d51-4bb1-b773-8d6e77bdf687 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 20 04:55:10.338767 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1e4a1ba5-4d51-4bb1-b773-8d6e77bdf687 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:10.339249 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1e4a1ba5-4d51-4bb1-b773-8d6e77bdf687 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:10.339710 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1e4a1ba5-4d51-4bb1-b773-8d6e77bdf687 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:10.340422 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1e4a1ba5-4d51-4bb1-b773-8d6e77bdf687 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:10.340900 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1e4a1ba5-4d51-4bb1-b773-8d6e77bdf687 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:10.341318 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1e4a1ba5-4d51-4bb1-b773-8d6e77bdf687 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:10.357954 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-1e4a1ba5-4d51-4bb1-b773-8d6e77bdf687 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Getting quotas for project 2bf8a8097f514bd5b31f5962183fb471. Resources: {'ram', 'cores', 'instances'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 04:55:10.361846 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-1e4a1ba5-4d51-4bb1-b773-8d6e77bdf687 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Getting quotas for user 58589e0cbfe84948bcdfb823502ec98d and project 2bf8a8097f514bd5b31f5962183fb471. Resources: {'ram', 'cores', 'instances'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 04:55:10.372493 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-1e4a1ba5-4d51-4bb1-b773-8d6e77bdf687 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Going to run 1 instances... {{(pid=126813) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 20 04:55:10.374836 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-1e4a1ba5-4d51-4bb1-b773-8d6e77bdf687 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] [instance: 27044daa-50a4-42de-b2e9-d5dbf7a62e75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='080ea053-830e-4470-a886-0ab99b0ab3e0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126813) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 20 04:55:10.425954 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-1e4a1ba5-4d51-4bb1-b773-8d6e77bdf687 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.428058 Sep 20 04:55:10.426804 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 155/305] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Sep 20 04:55:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 430 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 20 04:55:10.438459 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-7fae675e-ccc1-41e4-bfb1-f8c6d4d4b70c tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:10.439080 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-7fae675e-ccc1-41e4-bfb1-f8c6d4d4b70c tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] [instance: 27044daa-50a4-42de-b2e9-d5dbf7a62e75] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:10.491585 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-7fae675e-ccc1-41e4-bfb1-f8c6d4d4b70c tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58589e0cbfe84948bcdfb823502ec98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf8a8097f514bd5b31f5962183fb471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:55:10.498561 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-7fae675e-ccc1-41e4-bfb1-f8c6d4d4b70c tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] 10.222.0.27 "GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75" status: 200 len: 1213 microversion: 2.1 time: 0.064296 Sep 20 04:55:10.499126 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 156/306] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:10 2022] GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75 => generated 1213 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:55:11.521283 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-ac3105c9-90c4-405f-84e1-a663033ddb50 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:11.521897 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-ac3105c9-90c4-405f-84e1-a663033ddb50 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] [instance: 27044daa-50a4-42de-b2e9-d5dbf7a62e75] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:11.529053 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ac3105c9-90c4-405f-84e1-a663033ddb50 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:11.529541 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ac3105c9-90c4-405f-84e1-a663033ddb50 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:11.529973 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ac3105c9-90c4-405f-84e1-a663033ddb50 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:11.530661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ac3105c9-90c4-405f-84e1-a663033ddb50 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:11.531113 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ac3105c9-90c4-405f-84e1-a663033ddb50 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:11.531538 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ac3105c9-90c4-405f-84e1-a663033ddb50 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:11.592291 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-ac3105c9-90c4-405f-84e1-a663033ddb50 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58589e0cbfe84948bcdfb823502ec98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf8a8097f514bd5b31f5962183fb471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:55:11.600471 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-ac3105c9-90c4-405f-84e1-a663033ddb50 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] 10.222.0.27 "GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75" status: 200 len: 1265 microversion: 2.1 time: 0.083275 Sep 20 04:55:11.601057 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 157/307] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:11 2022] GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75 => generated 1265 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:55:12.623832 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-34e03210-74d5-46db-a744-93b18a3b1307 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:12.624467 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-34e03210-74d5-46db-a744-93b18a3b1307 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] [instance: 27044daa-50a4-42de-b2e9-d5dbf7a62e75] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:12.630931 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-34e03210-74d5-46db-a744-93b18a3b1307 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:12.631427 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-34e03210-74d5-46db-a744-93b18a3b1307 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:12.631866 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-34e03210-74d5-46db-a744-93b18a3b1307 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:12.632551 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-34e03210-74d5-46db-a744-93b18a3b1307 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:12.633038 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-34e03210-74d5-46db-a744-93b18a3b1307 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:12.633468 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-34e03210-74d5-46db-a744-93b18a3b1307 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:12.693807 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-34e03210-74d5-46db-a744-93b18a3b1307 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58589e0cbfe84948bcdfb823502ec98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf8a8097f514bd5b31f5962183fb471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:55:12.701390 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-34e03210-74d5-46db-a744-93b18a3b1307 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] 10.222.0.27 "GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75" status: 200 len: 1271 microversion: 2.1 time: 0.081418 Sep 20 04:55:12.701954 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 158/308] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:12 2022] GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75 => generated 1271 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:55:13.725976 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-38f53e1a-adc1-4ed9-bccc-2ede4aba0da9 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:13.726867 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-38f53e1a-adc1-4ed9-bccc-2ede4aba0da9 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] [instance: 27044daa-50a4-42de-b2e9-d5dbf7a62e75] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:13.733334 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-38f53e1a-adc1-4ed9-bccc-2ede4aba0da9 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:13.733812 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-38f53e1a-adc1-4ed9-bccc-2ede4aba0da9 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:13.734246 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-38f53e1a-adc1-4ed9-bccc-2ede4aba0da9 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:13.734921 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-38f53e1a-adc1-4ed9-bccc-2ede4aba0da9 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:13.735373 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-38f53e1a-adc1-4ed9-bccc-2ede4aba0da9 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:13.736415 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-38f53e1a-adc1-4ed9-bccc-2ede4aba0da9 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:13.795678 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-38f53e1a-adc1-4ed9-bccc-2ede4aba0da9 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58589e0cbfe84948bcdfb823502ec98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf8a8097f514bd5b31f5962183fb471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:55:13.804666 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-38f53e1a-adc1-4ed9-bccc-2ede4aba0da9 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] 10.222.0.27 "GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75" status: 200 len: 1271 microversion: 2.1 time: 0.082380 Sep 20 04:55:13.805362 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 159/309] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:13 2022] GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75 => generated 1271 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:55:14.827287 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-a5064f16-3a86-4080-9f32-3fe4ecf82d20 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:14.827914 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-a5064f16-3a86-4080-9f32-3fe4ecf82d20 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] [instance: 27044daa-50a4-42de-b2e9-d5dbf7a62e75] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:14.834279 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a5064f16-3a86-4080-9f32-3fe4ecf82d20 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:14.834804 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a5064f16-3a86-4080-9f32-3fe4ecf82d20 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:14.835289 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a5064f16-3a86-4080-9f32-3fe4ecf82d20 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:14.836066 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a5064f16-3a86-4080-9f32-3fe4ecf82d20 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:14.836566 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a5064f16-3a86-4080-9f32-3fe4ecf82d20 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:14.837024 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a5064f16-3a86-4080-9f32-3fe4ecf82d20 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:14.902039 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-a5064f16-3a86-4080-9f32-3fe4ecf82d20 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58589e0cbfe84948bcdfb823502ec98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf8a8097f514bd5b31f5962183fb471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:55:14.909689 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-a5064f16-3a86-4080-9f32-3fe4ecf82d20 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] 10.222.0.27 "GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75" status: 200 len: 1271 microversion: 2.1 time: 0.086251 Sep 20 04:55:14.910244 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 160/310] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:14 2022] GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75 => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:55:15.219116 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 20 04:55:15.219608 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: Tue Sep 20 04:55:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.27) !!! Sep 20 04:55:15.931737 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-8d5d73e3-dc18-4e3c-8ee7-3385778784d6 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:15.932346 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-8d5d73e3-dc18-4e3c-8ee7-3385778784d6 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] [instance: 27044daa-50a4-42de-b2e9-d5dbf7a62e75] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:15.939258 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8d5d73e3-dc18-4e3c-8ee7-3385778784d6 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:15.939737 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8d5d73e3-dc18-4e3c-8ee7-3385778784d6 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:15.940172 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8d5d73e3-dc18-4e3c-8ee7-3385778784d6 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:15.940894 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8d5d73e3-dc18-4e3c-8ee7-3385778784d6 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:15.941345 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8d5d73e3-dc18-4e3c-8ee7-3385778784d6 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:15.941764 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8d5d73e3-dc18-4e3c-8ee7-3385778784d6 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:16.002293 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-8d5d73e3-dc18-4e3c-8ee7-3385778784d6 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58589e0cbfe84948bcdfb823502ec98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf8a8097f514bd5b31f5962183fb471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:55:16.009806 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-8d5d73e3-dc18-4e3c-8ee7-3385778784d6 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] 10.222.0.27 "GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75" status: 200 len: 1271 microversion: 2.1 time: 0.081926 Sep 20 04:55:16.010378 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 161/311] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:15 2022] GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75 => generated 1271 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:55:17.033774 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-95070e2b-0c2f-4ac0-807e-b9d6bb6bda76 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:17.034433 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-95070e2b-0c2f-4ac0-807e-b9d6bb6bda76 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] [instance: 27044daa-50a4-42de-b2e9-d5dbf7a62e75] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:17.040859 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-95070e2b-0c2f-4ac0-807e-b9d6bb6bda76 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:17.041346 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-95070e2b-0c2f-4ac0-807e-b9d6bb6bda76 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:17.041781 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-95070e2b-0c2f-4ac0-807e-b9d6bb6bda76 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:17.042468 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-95070e2b-0c2f-4ac0-807e-b9d6bb6bda76 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:17.042916 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-95070e2b-0c2f-4ac0-807e-b9d6bb6bda76 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:17.043338 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-95070e2b-0c2f-4ac0-807e-b9d6bb6bda76 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:17.103344 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-95070e2b-0c2f-4ac0-807e-b9d6bb6bda76 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58589e0cbfe84948bcdfb823502ec98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf8a8097f514bd5b31f5962183fb471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:55:17.110986 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-95070e2b-0c2f-4ac0-807e-b9d6bb6bda76 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] 10.222.0.27 "GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75" status: 200 len: 1271 microversion: 2.1 time: 0.081677 Sep 20 04:55:17.111551 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 162/312] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:17 2022] GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75 => generated 1271 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:55:18.135319 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-a99d33b0-1d79-45ab-9f0a-3b7962754431 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:18.136496 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-a99d33b0-1d79-45ab-9f0a-3b7962754431 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] [instance: 27044daa-50a4-42de-b2e9-d5dbf7a62e75] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:18.144478 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a99d33b0-1d79-45ab-9f0a-3b7962754431 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:18.145004 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a99d33b0-1d79-45ab-9f0a-3b7962754431 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:18.145462 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a99d33b0-1d79-45ab-9f0a-3b7962754431 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:18.146162 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a99d33b0-1d79-45ab-9f0a-3b7962754431 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:18.146617 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a99d33b0-1d79-45ab-9f0a-3b7962754431 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:18.147159 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a99d33b0-1d79-45ab-9f0a-3b7962754431 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:18.283427 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-a99d33b0-1d79-45ab-9f0a-3b7962754431 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58589e0cbfe84948bcdfb823502ec98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf8a8097f514bd5b31f5962183fb471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:55:18.291070 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-a99d33b0-1d79-45ab-9f0a-3b7962754431 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] 10.222.0.27 "GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75" status: 200 len: 1313 microversion: 2.1 time: 0.161208 Sep 20 04:55:18.291640 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 163/313] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:18 2022] GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:55:18.975585 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-dc031b0e-12bf-4a5a-bc78-e1756f699cf3 req-704791dc-aa9e-4e96-8f05-c3b8b9421502 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27044daa-50a4-42de-b2e9-d5dbf7a62e75", "tag": "a9a2bb71-f508-4cc7-9a58-ea451cf8ac6a"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:55:18.985942 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-dc031b0e-12bf-4a5a-bc78-e1756f699cf3 req-704791dc-aa9e-4e96-8f05-c3b8b9421502 service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:18.986526 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-dc031b0e-12bf-4a5a-bc78-e1756f699cf3 req-704791dc-aa9e-4e96-8f05-c3b8b9421502 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:18.987023 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-dc031b0e-12bf-4a5a-bc78-e1756f699cf3 req-704791dc-aa9e-4e96-8f05-c3b8b9421502 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:18.997981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-dc031b0e-12bf-4a5a-bc78-e1756f699cf3 req-704791dc-aa9e-4e96-8f05-c3b8b9421502 service nova] Creating event network-changed:a9a2bb71-f508-4cc7-9a58-ea451cf8ac6a for instance 27044daa-50a4-42de-b2e9-d5dbf7a62e75 on hv-cinder-75671 Sep 20 04:55:19.003033 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-dc031b0e-12bf-4a5a-bc78-e1756f699cf3 req-704791dc-aa9e-4e96-8f05-c3b8b9421502 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031263 Sep 20 04:55:19.003716 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 164/314] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 04:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:55:19.315772 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-ccd64174-3fd6-47d1-bb69-3b6d8df55f53 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:19.316590 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-ccd64174-3fd6-47d1-bb69-3b6d8df55f53 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] [instance: 27044daa-50a4-42de-b2e9-d5dbf7a62e75] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:19.322678 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ccd64174-3fd6-47d1-bb69-3b6d8df55f53 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:19.323157 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ccd64174-3fd6-47d1-bb69-3b6d8df55f53 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:19.323587 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ccd64174-3fd6-47d1-bb69-3b6d8df55f53 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:19.324268 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ccd64174-3fd6-47d1-bb69-3b6d8df55f53 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:19.324740 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ccd64174-3fd6-47d1-bb69-3b6d8df55f53 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:19.325164 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ccd64174-3fd6-47d1-bb69-3b6d8df55f53 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:19.508669 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-ccd64174-3fd6-47d1-bb69-3b6d8df55f53 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58589e0cbfe84948bcdfb823502ec98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf8a8097f514bd5b31f5962183fb471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:55:19.516309 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-ccd64174-3fd6-47d1-bb69-3b6d8df55f53 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] 10.222.0.27 "GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75" status: 200 len: 1313 microversion: 2.1 time: 0.205270 Sep 20 04:55:19.517458 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 165/315] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:19 2022] GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75 => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:55:20.539325 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-fb24a9c7-3c6b-42c8-80b2-72fe09bca337 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:20.539937 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-fb24a9c7-3c6b-42c8-80b2-72fe09bca337 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] [instance: 27044daa-50a4-42de-b2e9-d5dbf7a62e75] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:20.542379 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell0:SELECT=2 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:55:20.543073 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell0:SELECT=8 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:55:20.549823 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fb24a9c7-3c6b-42c8-80b2-72fe09bca337 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:20.550312 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fb24a9c7-3c6b-42c8-80b2-72fe09bca337 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:20.550752 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fb24a9c7-3c6b-42c8-80b2-72fe09bca337 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:20.551535 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fb24a9c7-3c6b-42c8-80b2-72fe09bca337 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:20.551898 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fb24a9c7-3c6b-42c8-80b2-72fe09bca337 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:20.552362 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fb24a9c7-3c6b-42c8-80b2-72fe09bca337 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:20.686517 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-fb24a9c7-3c6b-42c8-80b2-72fe09bca337 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58589e0cbfe84948bcdfb823502ec98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf8a8097f514bd5b31f5962183fb471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:55:20.694122 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-fb24a9c7-3c6b-42c8-80b2-72fe09bca337 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] 10.222.0.27 "GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75" status: 200 len: 1313 microversion: 2.1 time: 0.158729 Sep 20 04:55:20.694677 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 166/316] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:20 2022] GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:55:21.716367 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-bcb29424-baac-459e-941a-304a726a97c1 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:21.717008 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-bcb29424-baac-459e-941a-304a726a97c1 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] [instance: 27044daa-50a4-42de-b2e9-d5dbf7a62e75] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:21.723695 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-bcb29424-baac-459e-941a-304a726a97c1 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:21.724177 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-bcb29424-baac-459e-941a-304a726a97c1 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:21.724626 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-bcb29424-baac-459e-941a-304a726a97c1 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:21.725329 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-bcb29424-baac-459e-941a-304a726a97c1 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:21.725779 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-bcb29424-baac-459e-941a-304a726a97c1 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:21.726202 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-bcb29424-baac-459e-941a-304a726a97c1 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:21.850510 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-bcb29424-baac-459e-941a-304a726a97c1 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58589e0cbfe84948bcdfb823502ec98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf8a8097f514bd5b31f5962183fb471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:55:21.858090 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-bcb29424-baac-459e-941a-304a726a97c1 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] 10.222.0.27 "GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75" status: 200 len: 1313 microversion: 2.1 time: 0.145527 Sep 20 04:55:21.858649 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 167/317] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:21 2022] GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:55:22.881041 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-a66ddbe6-7238-43e6-b657-874e170c9d15 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:22.881690 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-a66ddbe6-7238-43e6-b657-874e170c9d15 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] [instance: 27044daa-50a4-42de-b2e9-d5dbf7a62e75] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:22.888027 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a66ddbe6-7238-43e6-b657-874e170c9d15 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:22.888506 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a66ddbe6-7238-43e6-b657-874e170c9d15 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:22.888969 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a66ddbe6-7238-43e6-b657-874e170c9d15 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:22.889668 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a66ddbe6-7238-43e6-b657-874e170c9d15 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:22.890118 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a66ddbe6-7238-43e6-b657-874e170c9d15 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:22.890537 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a66ddbe6-7238-43e6-b657-874e170c9d15 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:23.018798 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-a66ddbe6-7238-43e6-b657-874e170c9d15 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58589e0cbfe84948bcdfb823502ec98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf8a8097f514bd5b31f5962183fb471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:55:23.026442 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-a66ddbe6-7238-43e6-b657-874e170c9d15 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] 10.222.0.27 "GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75" status: 200 len: 1313 microversion: 2.1 time: 0.149668 Sep 20 04:55:23.027002 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 168/318] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:22 2022] GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:55:24.050163 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-5fe7f8ff-1743-49f1-9ec7-1ada1e64f537 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:24.050796 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-5fe7f8ff-1743-49f1-9ec7-1ada1e64f537 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] [instance: 27044daa-50a4-42de-b2e9-d5dbf7a62e75] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:24.057410 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5fe7f8ff-1743-49f1-9ec7-1ada1e64f537 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:24.057893 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5fe7f8ff-1743-49f1-9ec7-1ada1e64f537 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:24.058329 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5fe7f8ff-1743-49f1-9ec7-1ada1e64f537 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:24.059013 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5fe7f8ff-1743-49f1-9ec7-1ada1e64f537 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:24.059467 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5fe7f8ff-1743-49f1-9ec7-1ada1e64f537 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:24.059890 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5fe7f8ff-1743-49f1-9ec7-1ada1e64f537 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:24.413731 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-5fe7f8ff-1743-49f1-9ec7-1ada1e64f537 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58589e0cbfe84948bcdfb823502ec98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf8a8097f514bd5b31f5962183fb471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:55:24.421368 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-5fe7f8ff-1743-49f1-9ec7-1ada1e64f537 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] 10.222.0.27 "GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75" status: 200 len: 1313 microversion: 2.1 time: 0.375042 Sep 20 04:55:24.421930 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 169/319] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:24 2022] GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75 => generated 1313 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:55:25.444942 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-fb3c0847-e93f-4829-a0d8-247ad31f5574 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:25.445590 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-fb3c0847-e93f-4829-a0d8-247ad31f5574 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] [instance: 27044daa-50a4-42de-b2e9-d5dbf7a62e75] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:25.451884 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fb3c0847-e93f-4829-a0d8-247ad31f5574 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:25.452353 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fb3c0847-e93f-4829-a0d8-247ad31f5574 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:25.452821 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fb3c0847-e93f-4829-a0d8-247ad31f5574 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:25.453505 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fb3c0847-e93f-4829-a0d8-247ad31f5574 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:25.454534 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fb3c0847-e93f-4829-a0d8-247ad31f5574 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:25.454961 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fb3c0847-e93f-4829-a0d8-247ad31f5574 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:25.585760 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-fb3c0847-e93f-4829-a0d8-247ad31f5574 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58589e0cbfe84948bcdfb823502ec98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf8a8097f514bd5b31f5962183fb471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:55:25.593546 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-fb3c0847-e93f-4829-a0d8-247ad31f5574 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] 10.222.0.27 "GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75" status: 200 len: 1313 microversion: 2.1 time: 0.152687 Sep 20 04:55:25.594118 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 170/320] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:25 2022] GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:55:26.615048 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-3f7e80ed-9eb9-49a4-85f4-5abb0ab390c4 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:26.615704 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-3f7e80ed-9eb9-49a4-85f4-5abb0ab390c4 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] [instance: 27044daa-50a4-42de-b2e9-d5dbf7a62e75] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:26.622107 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3f7e80ed-9eb9-49a4-85f4-5abb0ab390c4 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:26.622588 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3f7e80ed-9eb9-49a4-85f4-5abb0ab390c4 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:26.623022 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3f7e80ed-9eb9-49a4-85f4-5abb0ab390c4 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:26.623701 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3f7e80ed-9eb9-49a4-85f4-5abb0ab390c4 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:26.624152 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3f7e80ed-9eb9-49a4-85f4-5abb0ab390c4 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:26.624575 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3f7e80ed-9eb9-49a4-85f4-5abb0ab390c4 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:26.643630 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:55:26.760892 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-3f7e80ed-9eb9-49a4-85f4-5abb0ab390c4 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58589e0cbfe84948bcdfb823502ec98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf8a8097f514bd5b31f5962183fb471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:55:26.769603 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-3f7e80ed-9eb9-49a4-85f4-5abb0ab390c4 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] 10.222.0.27 "GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75" status: 200 len: 1313 microversion: 2.1 time: 0.158307 Sep 20 04:55:26.770392 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 171/321] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:26 2022] GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:55:27.791200 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-6ef06246-9489-422e-90f4-7be9b3118299 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:27.791860 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-6ef06246-9489-422e-90f4-7be9b3118299 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] [instance: 27044daa-50a4-42de-b2e9-d5dbf7a62e75] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:27.798333 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6ef06246-9489-422e-90f4-7be9b3118299 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:27.798820 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6ef06246-9489-422e-90f4-7be9b3118299 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:27.799296 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6ef06246-9489-422e-90f4-7be9b3118299 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:27.799972 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6ef06246-9489-422e-90f4-7be9b3118299 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:27.800464 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6ef06246-9489-422e-90f4-7be9b3118299 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:27.800869 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6ef06246-9489-422e-90f4-7be9b3118299 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:27.938469 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-6ef06246-9489-422e-90f4-7be9b3118299 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58589e0cbfe84948bcdfb823502ec98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf8a8097f514bd5b31f5962183fb471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:55:27.947656 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-6ef06246-9489-422e-90f4-7be9b3118299 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] 10.222.0.27 "GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75" status: 200 len: 1313 microversion: 2.1 time: 0.160216 Sep 20 04:55:27.948521 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 172/322] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:27 2022] GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:55:28.453675 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-36061bd2-c9b2-40cc-b3a1-3f7c80f1813f req-6568bf0b-248a-456e-b8d1-1431042a18d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27044daa-50a4-42de-b2e9-d5dbf7a62e75", "name": "network-vif-plugged", "status": "completed", "tag": "a9a2bb71-f508-4cc7-9a58-ea451cf8ac6a"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:55:28.463311 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-36061bd2-c9b2-40cc-b3a1-3f7c80f1813f req-6568bf0b-248a-456e-b8d1-1431042a18d3 service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:28.463813 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-36061bd2-c9b2-40cc-b3a1-3f7c80f1813f req-6568bf0b-248a-456e-b8d1-1431042a18d3 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:28.464259 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-36061bd2-c9b2-40cc-b3a1-3f7c80f1813f req-6568bf0b-248a-456e-b8d1-1431042a18d3 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:28.475215 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-36061bd2-c9b2-40cc-b3a1-3f7c80f1813f req-6568bf0b-248a-456e-b8d1-1431042a18d3 service nova] Creating event network-vif-plugged:a9a2bb71-f508-4cc7-9a58-ea451cf8ac6a for instance 27044daa-50a4-42de-b2e9-d5dbf7a62e75 on hv-cinder-75671 Sep 20 04:55:28.480246 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-36061bd2-c9b2-40cc-b3a1-3f7c80f1813f req-6568bf0b-248a-456e-b8d1-1431042a18d3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030361 Sep 20 04:55:28.481074 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 173/323] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 04:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 04:55:28.972342 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-6fc8c83e-0ffb-499f-baed-43867c5eafd6 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:28.973053 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-6fc8c83e-0ffb-499f-baed-43867c5eafd6 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] [instance: 27044daa-50a4-42de-b2e9-d5dbf7a62e75] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:28.979175 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6fc8c83e-0ffb-499f-baed-43867c5eafd6 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:28.979888 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6fc8c83e-0ffb-499f-baed-43867c5eafd6 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:28.980330 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6fc8c83e-0ffb-499f-baed-43867c5eafd6 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:28.981042 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6fc8c83e-0ffb-499f-baed-43867c5eafd6 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:28.981489 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6fc8c83e-0ffb-499f-baed-43867c5eafd6 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:28.981907 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6fc8c83e-0ffb-499f-baed-43867c5eafd6 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:29.110844 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-6fc8c83e-0ffb-499f-baed-43867c5eafd6 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58589e0cbfe84948bcdfb823502ec98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf8a8097f514bd5b31f5962183fb471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:55:29.118421 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-6fc8c83e-0ffb-499f-baed-43867c5eafd6 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] 10.222.0.27 "GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75" status: 200 len: 1313 microversion: 2.1 time: 0.151301 Sep 20 04:55:29.119318 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 174/324] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:28 2022] GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:55:30.141291 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-6cb9fdd6-62e1-42f3-8383-55cf9ec14b36 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:30.141927 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-6cb9fdd6-62e1-42f3-8383-55cf9ec14b36 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] [instance: 27044daa-50a4-42de-b2e9-d5dbf7a62e75] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:30.148541 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6cb9fdd6-62e1-42f3-8383-55cf9ec14b36 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:30.149052 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6cb9fdd6-62e1-42f3-8383-55cf9ec14b36 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:30.149489 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6cb9fdd6-62e1-42f3-8383-55cf9ec14b36 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:30.150199 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6cb9fdd6-62e1-42f3-8383-55cf9ec14b36 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:30.150650 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6cb9fdd6-62e1-42f3-8383-55cf9ec14b36 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:30.151068 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6cb9fdd6-62e1-42f3-8383-55cf9ec14b36 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:30.277630 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-6cb9fdd6-62e1-42f3-8383-55cf9ec14b36 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58589e0cbfe84948bcdfb823502ec98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf8a8097f514bd5b31f5962183fb471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:55:30.285808 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-6cb9fdd6-62e1-42f3-8383-55cf9ec14b36 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] 10.222.0.27 "GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75" status: 200 len: 1313 microversion: 2.1 time: 0.148352 Sep 20 04:55:30.286366 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 175/325] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:30 2022] GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:55:31.309140 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-7197edd9-725f-4f55-b357-c0bad4382d59 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:31.309822 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-7197edd9-725f-4f55-b357-c0bad4382d59 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] [instance: 27044daa-50a4-42de-b2e9-d5dbf7a62e75] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:31.316987 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7197edd9-725f-4f55-b357-c0bad4382d59 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:31.317465 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7197edd9-725f-4f55-b357-c0bad4382d59 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:31.317898 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7197edd9-725f-4f55-b357-c0bad4382d59 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:31.318576 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7197edd9-725f-4f55-b357-c0bad4382d59 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:31.319022 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7197edd9-725f-4f55-b357-c0bad4382d59 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:31.319440 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7197edd9-725f-4f55-b357-c0bad4382d59 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:31.444049 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-7197edd9-725f-4f55-b357-c0bad4382d59 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58589e0cbfe84948bcdfb823502ec98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf8a8097f514bd5b31f5962183fb471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:55:31.451834 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-7197edd9-725f-4f55-b357-c0bad4382d59 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] 10.222.0.27 "GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75" status: 200 len: 1313 microversion: 2.1 time: 0.146636 Sep 20 04:55:31.452430 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 176/326] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:31 2022] GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:55:32.003302 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-18e4a8f3-3f04-468e-865f-ba6d3d6e18a4 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:32.003794 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-18e4a8f3-3f04-468e-865f-ba6d3d6e18a4 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 60372fad-5a9d-4d04-89e4-8aca10601222] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:32.009841 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-18e4a8f3-3f04-468e-865f-ba6d3d6e18a4 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:32.010321 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-18e4a8f3-3f04-468e-865f-ba6d3d6e18a4 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:32.010754 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-18e4a8f3-3f04-468e-865f-ba6d3d6e18a4 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:32.011435 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-18e4a8f3-3f04-468e-865f-ba6d3d6e18a4 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:32.011886 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-18e4a8f3-3f04-468e-865f-ba6d3d6e18a4 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:32.012308 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-18e4a8f3-3f04-468e-865f-ba6d3d6e18a4 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:32.036569 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-18e4a8f3-3f04-468e-865f-ba6d3d6e18a4 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222/ips" status: 200 len: 151 microversion: 2.1 time: 0.037103 Sep 20 04:55:32.037146 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 177/327] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Sep 20 04:55:31 2022] GET /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 04:55:32.048278 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-2fde2c65-633c-4914-a1b8-0a2b8b878178 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce7be707-6e56-4737-bec2-4755c6c8c374"}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:55:32.050668 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-2fde2c65-633c-4914-a1b8-0a2b8b878178 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 60372fad-5a9d-4d04-89e4-8aca10601222] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:32.056347 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2fde2c65-633c-4914-a1b8-0a2b8b878178 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:32.056852 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2fde2c65-633c-4914-a1b8-0a2b8b878178 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:32.057283 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2fde2c65-633c-4914-a1b8-0a2b8b878178 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:32.057957 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2fde2c65-633c-4914-a1b8-0a2b8b878178 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:32.058404 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2fde2c65-633c-4914-a1b8-0a2b8b878178 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:32.058822 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2fde2c65-633c-4914-a1b8-0a2b8b878178 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:32.135999 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.wsgi [None req-2fde2c65-633c-4914-a1b8-0a2b8b878178 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] HTTP exception thrown: Invalid volume: volume ce7be707-6e56-4737-bec2-4755c6c8c374 is already attached to instances: 7723784c-51e5-4936-b33a-caf9b1b87bab Sep 20 04:55:32.137742 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-2fde2c65-633c-4914-a1b8-0a2b8b878178 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Request method failure captured: Sep 20 04:55:32.137742 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: request: POST /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222/os-volume_attachments HTTP/1.1 Sep 20 04:55:32.137742 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept: application/json Sep 20 04:55:32.137742 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept-Encoding: identity Sep 20 04:55:32.137742 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Connection: close Sep 20 04:55:32.137742 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Length: 74 Sep 20 04:55:32.137742 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Type: application/json Sep 20 04:55:32.137742 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Host: 10.222.0.27 Sep 20 04:55:32.137742 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Openstack-System-Scope: None Sep 20 04:55:32.137742 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: User-Agent: python-urllib3/1.26.12 Sep 20 04:55:32.137742 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Auth-Token: gAAAAABjKUbv3hCswc9OTl1x4i1QFI6XV3GUT2FYN7UTgjG9dzuM3jqx_GcwO4w0JWwRz9sTS2WwajnGfx2wJ2_1hAz4UUEc_snPtCtdpEIJJc5Fb8lrnltNsG7f_iYNiB6Uy9F1dOvGdMIHwFbxpPMJ6tdvqkqh2eaYhvMGxVgemwP0gnqQm2U Sep 20 04:55:32.137742 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Id: None Sep 20 04:55:32.137742 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Name: None Sep 20 04:55:32.137742 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Identity-Status: Confirmed Sep 20 04:55:32.137742 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Is-Admin-Project: True Sep 20 04:55:32.137742 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Id: default Sep 20 04:55:32.137742 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Name: Default Sep 20 04:55:32.137742 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Id: 4f0f0b8842ae496292c27a6ee1350d32 Sep 20 04:55:32.137742 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Name: tempest-AttachVolumeNegativeTest-1482924724 Sep 20 04:55:32.137742 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Role: reader,member Sep 20 04:55:32.137742 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Roles: reader,member Sep 20 04:55:32.139310 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f0f0b8842ae496292c27a6ee1350d32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f0f0b8842ae496292c27a6ee1350d32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4f0f0b8842ae496292c27a6ee1350d32", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4f0f0b8842ae496292c27a6ee1350d32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 04:55:32.139310 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant: tempest-AttachVolumeNegativeTest-1482924724 Sep 20 04:55:32.139310 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Id: 4f0f0b8842ae496292c27a6ee1350d32 Sep 20 04:55:32.139310 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1482924724 Sep 20 04:55:32.139310 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User: tempest-AttachVolumeNegativeTest-1482924724-project Sep 20 04:55:32.139310 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Id: default Sep 20 04:55:32.139310 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Name: Default Sep 20 04:55:32.139310 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Id: c93f22104a7b4a7caf0cc8b7180ffc55 Sep 20 04:55:32.139310 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Name: tempest-AttachVolumeNegativeTest-1482924724-project Sep 20 04:55:32.139310 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Sep 20 04:55:32.139310 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {"volumeAttachment": {"volumeId": "ce7be707-6e56-4737-bec2-4755c6c8c374"}} Sep 20 04:55:32.139310 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: method: > Sep 20 04:55:32.140114 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: exception: Invalid volume: volume ce7be707-6e56-4737-bec2-4755c6c8c374 is already attached to instances: 7723784c-51e5-4936-b33a-caf9b1b87bab Sep 20 04:55:32.140114 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: action_args: {'server_id': '60372fad-5a9d-4d04-89e4-8aca10601222', 'body': {'volumeAttachment': {'volumeId': 'ce7be707-6e56-4737-bec2-4755c6c8c374'}}} Sep 20 04:55:32.140114 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 04:55:32.140114 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:55:32.140114 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 20 04:55:32.140114 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 20 04:55:32.140114 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 20 04:55:32.140114 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 20 04:55:32.140114 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 20 04:55:32.140114 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 20 04:55:32.140114 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 20 04:55:32.140114 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 20 04:55:32.140114 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 20 04:55:32.140114 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 20 04:55:32.140114 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ce7be707-6e56-4737-bec2-4755c6c8c374 is already attached to instances: 7723784c-51e5-4936-b33a-caf9b1b87bab Sep 20 04:55:32.140114 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:55:32.140114 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:55:32.140114 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:55:32.140114 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:55:32.142030 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:55:32.142030 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:55:32.142030 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 04:55:32.142030 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 04:55:32.142030 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 04:55:32.142030 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 04:55:32.142030 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 20 04:55:32.142030 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 20 04:55:32.142030 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 20 04:55:32.142030 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 20 04:55:32.142030 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 20 04:55:32.142030 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 20 04:55:32.142030 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 20 04:55:32.142030 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 20 04:55:32.142030 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ce7be707-6e56-4737-bec2-4755c6c8c374 is already attached to instances: 7723784c-51e5-4936-b33a-caf9b1b87bab Sep 20 04:55:32.142030 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:55:32.142030 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:55:32.142030 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:55:32.142030 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:55:32.142030 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:55:32.144198 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:55:32.144198 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 04:55:32.144198 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 04:55:32.144198 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ce7be707-6e56-4737-bec2-4755c6c8c374 is already attached to instances: 7723784c-51e5-4936-b33a-caf9b1b87bab Sep 20 04:55:32.144198 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:55:32.144198 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-2fde2c65-633c-4914-a1b8-0a2b8b878178 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Returning 400 to user: Invalid volume: volume ce7be707-6e56-4737-bec2-4755c6c8c374 is already attached to instances: 7723784c-51e5-4936-b33a-caf9b1b87bab {{(pid=126813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 04:55:32.144198 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-2fde2c65-633c-4914-a1b8-0a2b8b878178 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "POST /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094676 Sep 20 04:55:32.144198 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 178/328] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Sep 20 04:55:32 2022] POST /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 20 04:55:32.149480 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-d02e81ac-fe66-4a2b-813e-f9ec81cfb2dc tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:32.149886 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-d02e81ac-fe66-4a2b-813e-f9ec81cfb2dc tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 60372fad-5a9d-4d04-89e4-8aca10601222] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:32.157375 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d02e81ac-fe66-4a2b-813e-f9ec81cfb2dc tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:32.157862 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d02e81ac-fe66-4a2b-813e-f9ec81cfb2dc tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:32.158752 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d02e81ac-fe66-4a2b-813e-f9ec81cfb2dc tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:32.159044 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d02e81ac-fe66-4a2b-813e-f9ec81cfb2dc tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:32.159399 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d02e81ac-fe66-4a2b-813e-f9ec81cfb2dc tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:32.159812 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d02e81ac-fe66-4a2b-813e-f9ec81cfb2dc tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:32.185187 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-d02e81ac-fe66-4a2b-813e-f9ec81cfb2dc tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 60372fad-5a9d-4d04-89e4-8aca10601222] Going to try to terminate instance {{(pid=126813) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 20 04:55:32.267507 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-d02e81ac-fe66-4a2b-813e-f9ec81cfb2dc tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "DELETE /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222" status: 204 len: 0 microversion: 2.1 time: 0.121380 Sep 20 04:55:32.268477 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 179/329] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Sep 20 04:55:32 2022] DELETE /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 20 04:55:32.277191 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-02b8e35f-29b8-4b5c-b3d4-8f70117aee97 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:32.277912 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-02b8e35f-29b8-4b5c-b3d4-8f70117aee97 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 60372fad-5a9d-4d04-89e4-8aca10601222] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:32.284400 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-02b8e35f-29b8-4b5c-b3d4-8f70117aee97 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:32.284939 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-02b8e35f-29b8-4b5c-b3d4-8f70117aee97 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:32.285391 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-02b8e35f-29b8-4b5c-b3d4-8f70117aee97 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:32.286121 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-02b8e35f-29b8-4b5c-b3d4-8f70117aee97 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:32.286595 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-02b8e35f-29b8-4b5c-b3d4-8f70117aee97 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:32.287021 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-02b8e35f-29b8-4b5c-b3d4-8f70117aee97 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:32.419226 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-02b8e35f-29b8-4b5c-b3d4-8f70117aee97 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:55:32.427042 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-02b8e35f-29b8-4b5c-b3d4-8f70117aee97 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222" status: 200 len: 1683 microversion: 2.1 time: 0.153895 Sep 20 04:55:32.427604 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 180/330] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:32 2022] GET /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:55:32.474694 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-08288a61-3902-43ed-a0e8-07bbab727534 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:32.475288 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-08288a61-3902-43ed-a0e8-07bbab727534 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] [instance: 27044daa-50a4-42de-b2e9-d5dbf7a62e75] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:32.481140 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-08288a61-3902-43ed-a0e8-07bbab727534 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:32.481619 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-08288a61-3902-43ed-a0e8-07bbab727534 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:32.482054 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-08288a61-3902-43ed-a0e8-07bbab727534 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:32.482736 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-08288a61-3902-43ed-a0e8-07bbab727534 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:32.483192 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-08288a61-3902-43ed-a0e8-07bbab727534 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:32.483612 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-08288a61-3902-43ed-a0e8-07bbab727534 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:32.610152 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-08288a61-3902-43ed-a0e8-07bbab727534 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58589e0cbfe84948bcdfb823502ec98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf8a8097f514bd5b31f5962183fb471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:55:32.617847 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-08288a61-3902-43ed-a0e8-07bbab727534 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] 10.222.0.27 "GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75" status: 200 len: 1313 microversion: 2.1 time: 0.146987 Sep 20 04:55:32.618345 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 181/331] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:32 2022] GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:55:33.450749 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-1a17c130-abd7-44c1-8cd4-0653e848adbe tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:33.451426 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-1a17c130-abd7-44c1-8cd4-0653e848adbe tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 60372fad-5a9d-4d04-89e4-8aca10601222] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:33.458253 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1a17c130-abd7-44c1-8cd4-0653e848adbe tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:33.458741 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1a17c130-abd7-44c1-8cd4-0653e848adbe tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:33.459170 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1a17c130-abd7-44c1-8cd4-0653e848adbe tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:33.459855 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1a17c130-abd7-44c1-8cd4-0653e848adbe tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:33.460305 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1a17c130-abd7-44c1-8cd4-0653e848adbe tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:33.460755 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1a17c130-abd7-44c1-8cd4-0653e848adbe tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:33.590565 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-1a17c130-abd7-44c1-8cd4-0653e848adbe tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:55:33.599018 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-1a17c130-abd7-44c1-8cd4-0653e848adbe tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222" status: 200 len: 1683 microversion: 2.1 time: 0.152102 Sep 20 04:55:33.599899 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 182/332] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:33 2022] GET /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:55:33.639822 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-7023ee28-e014-47e7-a097-7356c0485633 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:33.640445 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-7023ee28-e014-47e7-a097-7356c0485633 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] [instance: 27044daa-50a4-42de-b2e9-d5dbf7a62e75] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:33.646840 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7023ee28-e014-47e7-a097-7356c0485633 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:33.647318 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7023ee28-e014-47e7-a097-7356c0485633 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:33.647746 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7023ee28-e014-47e7-a097-7356c0485633 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:33.648416 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7023ee28-e014-47e7-a097-7356c0485633 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:33.648885 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7023ee28-e014-47e7-a097-7356c0485633 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:33.649303 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7023ee28-e014-47e7-a097-7356c0485633 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:33.780521 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-7023ee28-e014-47e7-a097-7356c0485633 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58589e0cbfe84948bcdfb823502ec98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf8a8097f514bd5b31f5962183fb471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:55:33.788891 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-7023ee28-e014-47e7-a097-7356c0485633 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] 10.222.0.27 "GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75" status: 200 len: 1313 microversion: 2.1 time: 0.152573 Sep 20 04:55:33.789450 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 183/333] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:33 2022] GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:55:34.623324 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-a3d21369-1809-4176-a250-5b4754122d34 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:34.624000 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-a3d21369-1809-4176-a250-5b4754122d34 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 60372fad-5a9d-4d04-89e4-8aca10601222] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:34.630657 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a3d21369-1809-4176-a250-5b4754122d34 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:34.631476 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a3d21369-1809-4176-a250-5b4754122d34 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:34.631913 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a3d21369-1809-4176-a250-5b4754122d34 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:34.632740 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a3d21369-1809-4176-a250-5b4754122d34 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:34.633250 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a3d21369-1809-4176-a250-5b4754122d34 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:34.633668 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a3d21369-1809-4176-a250-5b4754122d34 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:34.801115 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-a3d21369-1809-4176-a250-5b4754122d34 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:55:34.814010 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-a3d21369-1809-4176-a250-5b4754122d34 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222" status: 200 len: 1683 microversion: 2.1 time: 0.194598 Sep 20 04:55:34.814603 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 184/334] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:34 2022] GET /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222 => generated 1683 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:55:34.819020 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-3e11de39-6a1b-47c8-8c87-f6528183b994 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:34.819617 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-3e11de39-6a1b-47c8-8c87-f6528183b994 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] [instance: 27044daa-50a4-42de-b2e9-d5dbf7a62e75] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:34.825480 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3e11de39-6a1b-47c8-8c87-f6528183b994 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:34.825977 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3e11de39-6a1b-47c8-8c87-f6528183b994 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:34.826397 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3e11de39-6a1b-47c8-8c87-f6528183b994 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:34.827073 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3e11de39-6a1b-47c8-8c87-f6528183b994 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:34.827520 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3e11de39-6a1b-47c8-8c87-f6528183b994 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:34.827936 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3e11de39-6a1b-47c8-8c87-f6528183b994 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:35.096447 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-3e11de39-6a1b-47c8-8c87-f6528183b994 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58589e0cbfe84948bcdfb823502ec98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf8a8097f514bd5b31f5962183fb471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:55:35.104211 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-3e11de39-6a1b-47c8-8c87-f6528183b994 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] 10.222.0.27 "GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75" status: 200 len: 1462 microversion: 2.1 time: 0.288661 Sep 20 04:55:35.104925 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 185/335] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:34 2022] GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75 => generated 1462 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:55:35.151034 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-a4deb858-72d4-4bec-a5c8-93d629add47d tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:35.151564 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-a4deb858-72d4-4bec-a5c8-93d629add47d tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] [instance: 27044daa-50a4-42de-b2e9-d5dbf7a62e75] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:35.158501 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a4deb858-72d4-4bec-a5c8-93d629add47d tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:35.158988 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a4deb858-72d4-4bec-a5c8-93d629add47d tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:35.159425 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a4deb858-72d4-4bec-a5c8-93d629add47d tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:35.160121 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a4deb858-72d4-4bec-a5c8-93d629add47d tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:35.160574 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a4deb858-72d4-4bec-a5c8-93d629add47d tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:35.161032 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a4deb858-72d4-4bec-a5c8-93d629add47d tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:35.185572 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-a4deb858-72d4-4bec-a5c8-93d629add47d tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] [instance: 27044daa-50a4-42de-b2e9-d5dbf7a62e75] Going to try to terminate instance {{(pid=126813) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 20 04:55:35.212833 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:55:35.269009 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-a4deb858-72d4-4bec-a5c8-93d629add47d tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] 10.222.0.27 "DELETE /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75" status: 204 len: 0 microversion: 2.1 time: 0.121609 Sep 20 04:55:35.269599 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 186/336] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Sep 20 04:55:35 2022] DELETE /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 20 04:55:35.278095 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-f2001a3c-ecbf-4352-bd9c-c0048f5ab74c tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:35.278793 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-f2001a3c-ecbf-4352-bd9c-c0048f5ab74c tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] [instance: 27044daa-50a4-42de-b2e9-d5dbf7a62e75] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:35.285425 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f2001a3c-ecbf-4352-bd9c-c0048f5ab74c tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:35.285906 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f2001a3c-ecbf-4352-bd9c-c0048f5ab74c tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:35.286338 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f2001a3c-ecbf-4352-bd9c-c0048f5ab74c tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:35.287040 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f2001a3c-ecbf-4352-bd9c-c0048f5ab74c tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:35.287475 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f2001a3c-ecbf-4352-bd9c-c0048f5ab74c tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:35.287893 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f2001a3c-ecbf-4352-bd9c-c0048f5ab74c tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:35.482843 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-f2001a3c-ecbf-4352-bd9c-c0048f5ab74c tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58589e0cbfe84948bcdfb823502ec98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf8a8097f514bd5b31f5962183fb471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:55:35.493013 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-f2001a3c-ecbf-4352-bd9c-c0048f5ab74c tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] 10.222.0.27 "GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75" status: 200 len: 1468 microversion: 2.1 time: 0.218773 Sep 20 04:55:35.493878 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 187/337] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:35 2022] GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75 => generated 1468 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:55:35.498447 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-4a7b5c21-6369-4ce0-a8ef-3d6275ded0f3 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:35.498932 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-4a7b5c21-6369-4ce0-a8ef-3d6275ded0f3 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] [instance: f024434a-d44b-41f9-8818-da15a5d0a52d] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:35.505109 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4a7b5c21-6369-4ce0-a8ef-3d6275ded0f3 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:35.505587 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4a7b5c21-6369-4ce0-a8ef-3d6275ded0f3 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:35.506013 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4a7b5c21-6369-4ce0-a8ef-3d6275ded0f3 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:35.506687 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4a7b5c21-6369-4ce0-a8ef-3d6275ded0f3 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:35.507133 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4a7b5c21-6369-4ce0-a8ef-3d6275ded0f3 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:35.507547 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4a7b5c21-6369-4ce0-a8ef-3d6275ded0f3 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:35.640240 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.objects.instance [None req-4a7b5c21-6369-4ce0-a8ef-3d6275ded0f3 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lazy-loading 'services' on Instance uuid f024434a-d44b-41f9-8818-da15a5d0a52d {{(pid=126813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 04:55:35.763928 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-4a7b5c21-6369-4ce0-a8ef-3d6275ded0f3 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f024434a-d44b-41f9-8818-da15a5d0a52d/os-volume_attachments/03bb41d8-d802-4472-97a9-ad38d40b5fed" status: 202 len: 0 microversion: 2.1 time: 0.269028 Sep 20 04:55:35.767784 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 188/338] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Sep 20 04:55:35 2022] DELETE /compute/v2.1/servers/f024434a-d44b-41f9-8818-da15a5d0a52d/os-volume_attachments/03bb41d8-d802-4472-97a9-ad38d40b5fed => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 20 04:55:35.838512 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-b97bc21a-0d4a-4fd7-aa1b-4c58e69a7e2a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:35.839531 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-b97bc21a-0d4a-4fd7-aa1b-4c58e69a7e2a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 60372fad-5a9d-4d04-89e4-8aca10601222] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:35.842991 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:55:35.849460 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b97bc21a-0d4a-4fd7-aa1b-4c58e69a7e2a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:35.850267 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b97bc21a-0d4a-4fd7-aa1b-4c58e69a7e2a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:35.850807 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b97bc21a-0d4a-4fd7-aa1b-4c58e69a7e2a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:35.851627 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b97bc21a-0d4a-4fd7-aa1b-4c58e69a7e2a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:35.852386 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b97bc21a-0d4a-4fd7-aa1b-4c58e69a7e2a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:35.852932 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b97bc21a-0d4a-4fd7-aa1b-4c58e69a7e2a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:35.923443 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-b97bc21a-0d4a-4fd7-aa1b-4c58e69a7e2a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:55:35.931297 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-b97bc21a-0d4a-4fd7-aa1b-4c58e69a7e2a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222" status: 200 len: 1616 microversion: 2.1 time: 0.097100 Sep 20 04:55:35.931934 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 189/339] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:35 2022] GET /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222 => generated 1616 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:55:35.936343 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-7df2d0cf-8df1-4f65-a953-3189d378610c req-3f2aa828-2aa8-4f53-bbc5-ba5cacb3f0b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60372fad-5a9d-4d04-89e4-8aca10601222", "name": "network-vif-deleted", "tag": "9143766c-b4ab-434b-8c53-ed214e20f104"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:55:35.946127 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-7df2d0cf-8df1-4f65-a953-3189d378610c req-3f2aa828-2aa8-4f53-bbc5-ba5cacb3f0b0 service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:35.946615 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-7df2d0cf-8df1-4f65-a953-3189d378610c req-3f2aa828-2aa8-4f53-bbc5-ba5cacb3f0b0 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:35.947046 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-7df2d0cf-8df1-4f65-a953-3189d378610c req-3f2aa828-2aa8-4f53-bbc5-ba5cacb3f0b0 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:35.959346 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-7df2d0cf-8df1-4f65-a953-3189d378610c req-3f2aa828-2aa8-4f53-bbc5-ba5cacb3f0b0 service nova] Creating event network-vif-deleted:9143766c-b4ab-434b-8c53-ed214e20f104 for instance 60372fad-5a9d-4d04-89e4-8aca10601222 on hv-cinder-75671 Sep 20 04:55:35.964313 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-7df2d0cf-8df1-4f65-a953-3189d378610c req-3f2aa828-2aa8-4f53-bbc5-ba5cacb3f0b0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031275 Sep 20 04:55:35.964945 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 190/340] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 04:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:55:36.518501 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-b63346e8-f256-4f3e-acb4-a088e11dc018 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:36.519232 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-b63346e8-f256-4f3e-acb4-a088e11dc018 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] [instance: 27044daa-50a4-42de-b2e9-d5dbf7a62e75] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:36.525520 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b63346e8-f256-4f3e-acb4-a088e11dc018 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:36.526011 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b63346e8-f256-4f3e-acb4-a088e11dc018 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:36.526566 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b63346e8-f256-4f3e-acb4-a088e11dc018 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:36.527267 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b63346e8-f256-4f3e-acb4-a088e11dc018 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:36.527722 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b63346e8-f256-4f3e-acb4-a088e11dc018 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:36.528158 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b63346e8-f256-4f3e-acb4-a088e11dc018 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:36.690636 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-b63346e8-f256-4f3e-acb4-a088e11dc018 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58589e0cbfe84948bcdfb823502ec98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf8a8097f514bd5b31f5962183fb471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:55:36.698957 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-b63346e8-f256-4f3e-acb4-a088e11dc018 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] 10.222.0.27 "GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75" status: 200 len: 1468 microversion: 2.1 time: 0.185119 Sep 20 04:55:36.699523 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 191/341] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:36 2022] GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75 => generated 1468 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:55:36.954891 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-7a32a38d-c37e-4262-a0c4-43700cb54d0b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:36.955867 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-7a32a38d-c37e-4262-a0c4-43700cb54d0b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 60372fad-5a9d-4d04-89e4-8aca10601222] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:36.962229 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7a32a38d-c37e-4262-a0c4-43700cb54d0b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:36.962764 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7a32a38d-c37e-4262-a0c4-43700cb54d0b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:36.963219 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7a32a38d-c37e-4262-a0c4-43700cb54d0b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:36.963902 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7a32a38d-c37e-4262-a0c4-43700cb54d0b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:36.964351 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7a32a38d-c37e-4262-a0c4-43700cb54d0b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:36.964987 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7a32a38d-c37e-4262-a0c4-43700cb54d0b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:36.999565 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7a32a38d-c37e-4262-a0c4-43700cb54d0b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:37.000224 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7a32a38d-c37e-4262-a0c4-43700cb54d0b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:37.000816 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7a32a38d-c37e-4262-a0c4-43700cb54d0b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:37.001358 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.objects.instance [None req-7a32a38d-c37e-4262-a0c4-43700cb54d0b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lazy-loading 'fault' on Instance uuid 60372fad-5a9d-4d04-89e4-8aca10601222 {{(pid=126813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 04:55:37.053568 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-7a32a38d-c37e-4262-a0c4-43700cb54d0b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:55:37.062130 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-7a32a38d-c37e-4262-a0c4-43700cb54d0b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222" status: 200 len: 1332 microversion: 2.1 time: 0.111132 Sep 20 04:55:37.062718 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 192/342] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:36 2022] GET /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222 => generated 1332 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:55:37.722351 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-158effc2-39ec-4a0b-a81d-2ed3434ba129 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:37.722960 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-158effc2-39ec-4a0b-a81d-2ed3434ba129 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] [instance: 27044daa-50a4-42de-b2e9-d5dbf7a62e75] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:37.729467 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-158effc2-39ec-4a0b-a81d-2ed3434ba129 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:37.729949 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-158effc2-39ec-4a0b-a81d-2ed3434ba129 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:37.730378 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-158effc2-39ec-4a0b-a81d-2ed3434ba129 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:37.731398 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-158effc2-39ec-4a0b-a81d-2ed3434ba129 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:37.731923 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-158effc2-39ec-4a0b-a81d-2ed3434ba129 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:37.732451 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-158effc2-39ec-4a0b-a81d-2ed3434ba129 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:37.985188 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-158effc2-39ec-4a0b-a81d-2ed3434ba129 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58589e0cbfe84948bcdfb823502ec98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf8a8097f514bd5b31f5962183fb471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:55:37.995118 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-158effc2-39ec-4a0b-a81d-2ed3434ba129 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] 10.222.0.27 "GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75" status: 200 len: 1468 microversion: 2.1 time: 0.277095 Sep 20 04:55:37.995823 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 193/343] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:37 2022] GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75 => generated 1468 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:55:38.002165 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-37a55d69-a0d3-4490-85a6-d245d1966f66 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:38.002928 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-37a55d69-a0d3-4490-85a6-d245d1966f66 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] [instance: f024434a-d44b-41f9-8818-da15a5d0a52d] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:38.009158 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-37a55d69-a0d3-4490-85a6-d245d1966f66 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:38.009653 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-37a55d69-a0d3-4490-85a6-d245d1966f66 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:38.010092 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-37a55d69-a0d3-4490-85a6-d245d1966f66 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:38.010790 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-37a55d69-a0d3-4490-85a6-d245d1966f66 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:38.011245 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-37a55d69-a0d3-4490-85a6-d245d1966f66 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:38.011718 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-37a55d69-a0d3-4490-85a6-d245d1966f66 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:38.038256 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-37a55d69-a0d3-4490-85a6-d245d1966f66 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] [instance: f024434a-d44b-41f9-8818-da15a5d0a52d] Going to try to terminate instance {{(pid=126813) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 20 04:55:38.134691 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-37a55d69-a0d3-4490-85a6-d245d1966f66 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f024434a-d44b-41f9-8818-da15a5d0a52d" status: 204 len: 0 microversion: 2.1 time: 0.137403 Sep 20 04:55:38.138912 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 194/344] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Sep 20 04:55:37 2022] DELETE /compute/v2.1/servers/f024434a-d44b-41f9-8818-da15a5d0a52d => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 20 04:55:38.140216 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-e8326cef-6830-41ac-a03f-6ece56220b99 req-e2809cfe-b590-4245-8ad2-b80071ff8b5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27044daa-50a4-42de-b2e9-d5dbf7a62e75", "name": "network-vif-deleted", "tag": "a9a2bb71-f508-4cc7-9a58-ea451cf8ac6a"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:55:38.152664 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-e8326cef-6830-41ac-a03f-6ece56220b99 req-e2809cfe-b590-4245-8ad2-b80071ff8b5b service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:38.152664 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-e8326cef-6830-41ac-a03f-6ece56220b99 req-e2809cfe-b590-4245-8ad2-b80071ff8b5b service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:38.152664 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-e8326cef-6830-41ac-a03f-6ece56220b99 req-e2809cfe-b590-4245-8ad2-b80071ff8b5b service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:38.167778 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-e8326cef-6830-41ac-a03f-6ece56220b99 req-e2809cfe-b590-4245-8ad2-b80071ff8b5b service nova] Creating event network-vif-deleted:a9a2bb71-f508-4cc7-9a58-ea451cf8ac6a for instance 27044daa-50a4-42de-b2e9-d5dbf7a62e75 on hv-cinder-75671 Sep 20 04:55:38.172943 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-e8326cef-6830-41ac-a03f-6ece56220b99 req-e2809cfe-b590-4245-8ad2-b80071ff8b5b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036401 Sep 20 04:55:38.173627 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 195/345] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 04:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:55:38.181486 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-57b968a7-3169-4413-9b45-9fbf138cbb9a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:38.182173 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-57b968a7-3169-4413-9b45-9fbf138cbb9a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 60372fad-5a9d-4d04-89e4-8aca10601222] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:38.188973 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-57b968a7-3169-4413-9b45-9fbf138cbb9a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:38.189458 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-57b968a7-3169-4413-9b45-9fbf138cbb9a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:38.189892 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-57b968a7-3169-4413-9b45-9fbf138cbb9a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:38.190579 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-57b968a7-3169-4413-9b45-9fbf138cbb9a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:38.191050 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-57b968a7-3169-4413-9b45-9fbf138cbb9a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:38.191470 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-57b968a7-3169-4413-9b45-9fbf138cbb9a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:38.226428 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-57b968a7-3169-4413-9b45-9fbf138cbb9a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:38.226834 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-57b968a7-3169-4413-9b45-9fbf138cbb9a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:38.227271 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-57b968a7-3169-4413-9b45-9fbf138cbb9a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:38.227748 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.objects.instance [None req-57b968a7-3169-4413-9b45-9fbf138cbb9a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lazy-loading 'fault' on Instance uuid 60372fad-5a9d-4d04-89e4-8aca10601222 {{(pid=126813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 04:55:38.269424 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-57b968a7-3169-4413-9b45-9fbf138cbb9a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:55:38.277111 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-57b968a7-3169-4413-9b45-9fbf138cbb9a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222" status: 200 len: 1332 microversion: 2.1 time: 0.099516 Sep 20 04:55:38.277676 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 196/346] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:38 2022] GET /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222 => generated 1332 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:55:38.282660 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-85a65ccd-f877-4934-965d-687a0f0ff057 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:38.283328 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-85a65ccd-f877-4934-965d-687a0f0ff057 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] [instance: f024434a-d44b-41f9-8818-da15a5d0a52d] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:38.288931 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-85a65ccd-f877-4934-965d-687a0f0ff057 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:38.289415 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-85a65ccd-f877-4934-965d-687a0f0ff057 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:38.289849 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-85a65ccd-f877-4934-965d-687a0f0ff057 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:38.290532 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-85a65ccd-f877-4934-965d-687a0f0ff057 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:38.290999 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-85a65ccd-f877-4934-965d-687a0f0ff057 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:38.291404 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-85a65ccd-f877-4934-965d-687a0f0ff057 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:38.414836 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-85a65ccd-f877-4934-965d-687a0f0ff057 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d877f0c71f4e18854813780214ed6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725d386301d648de85fd6c4767250c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:55:38.423162 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-85a65ccd-f877-4934-965d-687a0f0ff057 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] 10.222.0.27 "GET /compute/v2.1/servers/f024434a-d44b-41f9-8818-da15a5d0a52d" status: 200 len: 1514 microversion: 2.1 time: 0.144550 Sep 20 04:55:38.423723 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 197/347] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:38 2022] GET /compute/v2.1/servers/f024434a-d44b-41f9-8818-da15a5d0a52d => generated 1514 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:55:39.020124 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-176697be-d2f9-44be-b23e-75dd53476eb3 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:39.020821 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-176697be-d2f9-44be-b23e-75dd53476eb3 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] [instance: 27044daa-50a4-42de-b2e9-d5dbf7a62e75] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:39.027231 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-176697be-d2f9-44be-b23e-75dd53476eb3 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:39.027709 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-176697be-d2f9-44be-b23e-75dd53476eb3 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:39.028141 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-176697be-d2f9-44be-b23e-75dd53476eb3 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:39.028844 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-176697be-d2f9-44be-b23e-75dd53476eb3 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:39.029291 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-176697be-d2f9-44be-b23e-75dd53476eb3 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:39.029707 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-176697be-d2f9-44be-b23e-75dd53476eb3 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:39.060436 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-176697be-d2f9-44be-b23e-75dd53476eb3 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:39.060933 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-176697be-d2f9-44be-b23e-75dd53476eb3 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:39.061364 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-176697be-d2f9-44be-b23e-75dd53476eb3 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:39.061797 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.objects.instance [None req-176697be-d2f9-44be-b23e-75dd53476eb3 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lazy-loading 'fault' on Instance uuid 27044daa-50a4-42de-b2e9-d5dbf7a62e75 {{(pid=126813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 04:55:39.105317 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-176697be-d2f9-44be-b23e-75dd53476eb3 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58589e0cbfe84948bcdfb823502ec98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf8a8097f514bd5b31f5962183fb471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:55:39.113036 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-176697be-d2f9-44be-b23e-75dd53476eb3 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] 10.222.0.27 "GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75" status: 200 len: 1303 microversion: 2.1 time: 0.097654 Sep 20 04:55:39.113594 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 198/348] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:39 2022] GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75 => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:55:39.303745 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-e0172e18-5a6d-4f1a-b7eb-2c97a3357e69 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:39.304264 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-e0172e18-5a6d-4f1a-b7eb-2c97a3357e69 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 60372fad-5a9d-4d04-89e4-8aca10601222] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:39.310926 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e0172e18-5a6d-4f1a-b7eb-2c97a3357e69 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:39.311415 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e0172e18-5a6d-4f1a-b7eb-2c97a3357e69 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:39.312012 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e0172e18-5a6d-4f1a-b7eb-2c97a3357e69 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:39.313589 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e0172e18-5a6d-4f1a-b7eb-2c97a3357e69 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:39.314046 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e0172e18-5a6d-4f1a-b7eb-2c97a3357e69 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:39.314467 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e0172e18-5a6d-4f1a-b7eb-2c97a3357e69 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:39.348051 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e0172e18-5a6d-4f1a-b7eb-2c97a3357e69 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:39.348530 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e0172e18-5a6d-4f1a-b7eb-2c97a3357e69 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:39.348988 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e0172e18-5a6d-4f1a-b7eb-2c97a3357e69 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:39.349437 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.objects.instance [None req-e0172e18-5a6d-4f1a-b7eb-2c97a3357e69 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lazy-loading 'fault' on Instance uuid 60372fad-5a9d-4d04-89e4-8aca10601222 {{(pid=126813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 04:55:39.391715 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-e0172e18-5a6d-4f1a-b7eb-2c97a3357e69 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:55:39.399952 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-e0172e18-5a6d-4f1a-b7eb-2c97a3357e69 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222" status: 200 len: 1332 microversion: 2.1 time: 0.102747 Sep 20 04:55:39.400528 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 199/349] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:39 2022] GET /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222 => generated 1332 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:55:39.445590 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-4b4b4d8e-5c77-4e12-8aad-2fb3315526b7 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:39.446209 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-4b4b4d8e-5c77-4e12-8aad-2fb3315526b7 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] [instance: f024434a-d44b-41f9-8818-da15a5d0a52d] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:39.452110 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4b4b4d8e-5c77-4e12-8aad-2fb3315526b7 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:39.452592 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4b4b4d8e-5c77-4e12-8aad-2fb3315526b7 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:39.453648 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4b4b4d8e-5c77-4e12-8aad-2fb3315526b7 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:39.454327 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4b4b4d8e-5c77-4e12-8aad-2fb3315526b7 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:39.454809 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4b4b4d8e-5c77-4e12-8aad-2fb3315526b7 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:39.455234 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4b4b4d8e-5c77-4e12-8aad-2fb3315526b7 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:39.459254 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=95,nova_cell1:INSERT=3 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:55:39.585345 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-4b4b4d8e-5c77-4e12-8aad-2fb3315526b7 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d877f0c71f4e18854813780214ed6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725d386301d648de85fd6c4767250c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:55:39.595619 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-4b4b4d8e-5c77-4e12-8aad-2fb3315526b7 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] 10.222.0.27 "GET /compute/v2.1/servers/f024434a-d44b-41f9-8818-da15a5d0a52d" status: 200 len: 1514 microversion: 2.1 time: 0.152940 Sep 20 04:55:39.596726 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 200/350] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:39 2022] GET /compute/v2.1/servers/f024434a-d44b-41f9-8818-da15a5d0a52d => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:55:40.139290 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-2415a8e9-8a82-4498-9f2f-0f03288ce011 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:40.139992 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-2415a8e9-8a82-4498-9f2f-0f03288ce011 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] [instance: 27044daa-50a4-42de-b2e9-d5dbf7a62e75] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:40.147794 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2415a8e9-8a82-4498-9f2f-0f03288ce011 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:40.148279 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2415a8e9-8a82-4498-9f2f-0f03288ce011 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:40.148751 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2415a8e9-8a82-4498-9f2f-0f03288ce011 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:40.149440 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2415a8e9-8a82-4498-9f2f-0f03288ce011 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:40.149889 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2415a8e9-8a82-4498-9f2f-0f03288ce011 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:40.150345 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2415a8e9-8a82-4498-9f2f-0f03288ce011 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:40.185956 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2415a8e9-8a82-4498-9f2f-0f03288ce011 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:40.186514 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2415a8e9-8a82-4498-9f2f-0f03288ce011 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:40.186952 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2415a8e9-8a82-4498-9f2f-0f03288ce011 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:40.187436 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.objects.instance [None req-2415a8e9-8a82-4498-9f2f-0f03288ce011 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lazy-loading 'fault' on Instance uuid 27044daa-50a4-42de-b2e9-d5dbf7a62e75 {{(pid=126813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 04:55:40.263984 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-2415a8e9-8a82-4498-9f2f-0f03288ce011 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58589e0cbfe84948bcdfb823502ec98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf8a8097f514bd5b31f5962183fb471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:55:40.272507 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-2415a8e9-8a82-4498-9f2f-0f03288ce011 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] 10.222.0.27 "GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75" status: 200 len: 1303 microversion: 2.1 time: 0.136977 Sep 20 04:55:40.273105 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 201/351] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:40 2022] GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75 => generated 1303 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:55:40.424353 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-7b9859ab-81f4-41a8-a339-a2924a7617fe tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:40.425005 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-7b9859ab-81f4-41a8-a339-a2924a7617fe tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 60372fad-5a9d-4d04-89e4-8aca10601222] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:40.430921 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7b9859ab-81f4-41a8-a339-a2924a7617fe tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:40.431403 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7b9859ab-81f4-41a8-a339-a2924a7617fe tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:40.431834 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7b9859ab-81f4-41a8-a339-a2924a7617fe tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:40.432574 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7b9859ab-81f4-41a8-a339-a2924a7617fe tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:40.433057 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7b9859ab-81f4-41a8-a339-a2924a7617fe tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:40.433481 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7b9859ab-81f4-41a8-a339-a2924a7617fe tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:40.449866 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.wsgi [None req-7b9859ab-81f4-41a8-a339-a2924a7617fe tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] HTTP exception thrown: Instance 60372fad-5a9d-4d04-89e4-8aca10601222 could not be found. Sep 20 04:55:40.451524 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-7b9859ab-81f4-41a8-a339-a2924a7617fe tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Request method failure captured: Sep 20 04:55:40.451524 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: request: GET /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222 HTTP/1.1 Sep 20 04:55:40.451524 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept: application/json Sep 20 04:55:40.451524 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept-Encoding: identity Sep 20 04:55:40.451524 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Connection: close Sep 20 04:55:40.451524 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Length: 0 Sep 20 04:55:40.451524 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Type: application/json Sep 20 04:55:40.451524 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Host: 10.222.0.27 Sep 20 04:55:40.451524 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Openstack-System-Scope: None Sep 20 04:55:40.451524 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: User-Agent: python-urllib3/1.26.12 Sep 20 04:55:40.451524 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Auth-Token: gAAAAABjKUbv3hCswc9OTl1x4i1QFI6XV3GUT2FYN7UTgjG9dzuM3jqx_GcwO4w0JWwRz9sTS2WwajnGfx2wJ2_1hAz4UUEc_snPtCtdpEIJJc5Fb8lrnltNsG7f_iYNiB6Uy9F1dOvGdMIHwFbxpPMJ6tdvqkqh2eaYhvMGxVgemwP0gnqQm2U Sep 20 04:55:40.451524 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Id: None Sep 20 04:55:40.451524 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Name: None Sep 20 04:55:40.451524 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Identity-Status: Confirmed Sep 20 04:55:40.451524 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Is-Admin-Project: True Sep 20 04:55:40.451524 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Id: default Sep 20 04:55:40.451524 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Name: Default Sep 20 04:55:40.451524 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Id: 4f0f0b8842ae496292c27a6ee1350d32 Sep 20 04:55:40.451524 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Name: tempest-AttachVolumeNegativeTest-1482924724 Sep 20 04:55:40.451524 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Role: reader,member Sep 20 04:55:40.451524 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Roles: reader,member Sep 20 04:55:40.453624 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f0f0b8842ae496292c27a6ee1350d32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f0f0b8842ae496292c27a6ee1350d32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4f0f0b8842ae496292c27a6ee1350d32", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4f0f0b8842ae496292c27a6ee1350d32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 04:55:40.453624 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant: tempest-AttachVolumeNegativeTest-1482924724 Sep 20 04:55:40.453624 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Id: 4f0f0b8842ae496292c27a6ee1350d32 Sep 20 04:55:40.453624 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1482924724 Sep 20 04:55:40.453624 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User: tempest-AttachVolumeNegativeTest-1482924724-project Sep 20 04:55:40.453624 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Id: default Sep 20 04:55:40.453624 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Name: Default Sep 20 04:55:40.453624 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Id: c93f22104a7b4a7caf0cc8b7180ffc55 Sep 20 04:55:40.453624 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Name: tempest-AttachVolumeNegativeTest-1482924724-project Sep 20 04:55:40.453624 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: method: > Sep 20 04:55:40.453624 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: exception: Instance 60372fad-5a9d-4d04-89e4-8aca10601222 could not be found. Sep 20 04:55:40.453624 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: action_args: {'id': '60372fad-5a9d-4d04-89e4-8aca10601222'} Sep 20 04:55:40.454357 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 04:55:40.454357 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:55:40.454357 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 04:55:40.454357 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 04:55:40.454357 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 04:55:40.454357 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 04:55:40.454357 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 04:55:40.454357 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 04:55:40.454357 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 04:55:40.454357 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 04:55:40.454357 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60372fad-5a9d-4d04-89e4-8aca10601222 could not be found. Sep 20 04:55:40.454357 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:55:40.454357 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:55:40.454357 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:55:40.454357 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:55:40.454357 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:55:40.454357 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:55:40.454357 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 04:55:40.454357 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 04:55:40.454357 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 04:55:40.455824 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 04:55:40.455824 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 04:55:40.455824 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 04:55:40.455824 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 04:55:40.455824 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 04:55:40.455824 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 04:55:40.455824 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 04:55:40.455824 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60372fad-5a9d-4d04-89e4-8aca10601222 could not be found. Sep 20 04:55:40.455824 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:55:40.455824 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:55:40.455824 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:55:40.455824 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:55:40.455824 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:55:40.455824 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:55:40.455824 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 04:55:40.455824 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 04:55:40.455824 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60372fad-5a9d-4d04-89e4-8aca10601222 could not be found. Sep 20 04:55:40.455824 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:55:40.457981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-7b9859ab-81f4-41a8-a339-a2924a7617fe tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Returning 404 to user: Instance 60372fad-5a9d-4d04-89e4-8aca10601222 could not be found. {{(pid=126813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 04:55:40.458989 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-7b9859ab-81f4-41a8-a339-a2924a7617fe tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222" status: 404 len: 111 microversion: 2.1 time: 0.039521 Sep 20 04:55:40.459600 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 202/352] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:40 2022] GET /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 20 04:55:40.468195 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-1d11eb54-3436-44bf-bb0d-5fc664c4ec75 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '.version_select at 0x7f2e4a7dc430>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:40.491822 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-1d11eb54-3436-44bf-bb0d-5fc664c4ec75 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1653829936" status: 202 len: 0 microversion: 2.1 time: 0.027807 Sep 20 04:55:40.492441 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 203/353] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Sep 20 04:55:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1653829936 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 20 04:55:40.572934 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-6e224e8a-7ddd-4bc3-b789-1bf80362b2f9 req-03e51eb2-6674-41ef-b1a2-09094f2c3b3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f024434a-d44b-41f9-8818-da15a5d0a52d", "name": "network-vif-deleted", "tag": "d063bff7-96f4-43ab-aeaf-6b6e6cab44e0"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:55:40.586154 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-6e224e8a-7ddd-4bc3-b789-1bf80362b2f9 req-03e51eb2-6674-41ef-b1a2-09094f2c3b3e service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:40.586915 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-6e224e8a-7ddd-4bc3-b789-1bf80362b2f9 req-03e51eb2-6674-41ef-b1a2-09094f2c3b3e service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:40.587537 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-6e224e8a-7ddd-4bc3-b789-1bf80362b2f9 req-03e51eb2-6674-41ef-b1a2-09094f2c3b3e service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:40.601126 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-6e224e8a-7ddd-4bc3-b789-1bf80362b2f9 req-03e51eb2-6674-41ef-b1a2-09094f2c3b3e service nova] Creating event network-vif-deleted:d063bff7-96f4-43ab-aeaf-6b6e6cab44e0 for instance f024434a-d44b-41f9-8818-da15a5d0a52d on hv-cinder-75671 Sep 20 04:55:40.606346 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-6e224e8a-7ddd-4bc3-b789-1bf80362b2f9 req-03e51eb2-6674-41ef-b1a2-09094f2c3b3e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038660 Sep 20 04:55:40.607242 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 204/354] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 04:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:55:40.623776 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-56ca4156-d191-4227-a255-23811f0b4fd3 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:40.624629 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-56ca4156-d191-4227-a255-23811f0b4fd3 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] [instance: f024434a-d44b-41f9-8818-da15a5d0a52d] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:40.632249 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-56ca4156-d191-4227-a255-23811f0b4fd3 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:40.633065 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-56ca4156-d191-4227-a255-23811f0b4fd3 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:40.633552 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-56ca4156-d191-4227-a255-23811f0b4fd3 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:40.634281 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-56ca4156-d191-4227-a255-23811f0b4fd3 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:40.634837 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-56ca4156-d191-4227-a255-23811f0b4fd3 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:40.635300 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-56ca4156-d191-4227-a255-23811f0b4fd3 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:40.737945 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-56ca4156-d191-4227-a255-23811f0b4fd3 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d877f0c71f4e18854813780214ed6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725d386301d648de85fd6c4767250c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:55:40.746097 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-56ca4156-d191-4227-a255-23811f0b4fd3 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] 10.222.0.27 "GET /compute/v2.1/servers/f024434a-d44b-41f9-8818-da15a5d0a52d" status: 200 len: 1304 microversion: 2.1 time: 0.126578 Sep 20 04:55:40.746982 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 205/355] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:40 2022] GET /compute/v2.1/servers/f024434a-d44b-41f9-8818-da15a5d0a52d => generated 1304 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:55:41.247494 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-d43468fb-6ca8-4930-bd27-ec04e82fc7b4 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:41.249095 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-d43468fb-6ca8-4930-bd27-ec04e82fc7b4 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:41.258128 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d43468fb-6ca8-4930-bd27-ec04e82fc7b4 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:41.258615 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d43468fb-6ca8-4930-bd27-ec04e82fc7b4 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:41.259053 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d43468fb-6ca8-4930-bd27-ec04e82fc7b4 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:41.259747 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d43468fb-6ca8-4930-bd27-ec04e82fc7b4 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:41.260202 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d43468fb-6ca8-4930-bd27-ec04e82fc7b4 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:41.260650 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d43468fb-6ca8-4930-bd27-ec04e82fc7b4 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:41.349842 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.objects.instance [None req-d43468fb-6ca8-4930-bd27-ec04e82fc7b4 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lazy-loading 'services' on Instance uuid 7723784c-51e5-4936-b33a-caf9b1b87bab {{(pid=126813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 04:55:41.422530 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-d43468fb-6ca8-4930-bd27-ec04e82fc7b4 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab/os-volume_attachments/ce7be707-6e56-4737-bec2-4755c6c8c374" status: 202 len: 0 microversion: 2.1 time: 0.179597 Sep 20 04:55:41.423263 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 206/356] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Sep 20 04:55:41 2022] DELETE /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab/os-volume_attachments/ce7be707-6e56-4737-bec2-4755c6c8c374 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 20 04:55:41.431458 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-d8ee7bd2-111c-49a6-b391-230f954626e2 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:41.432165 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-d8ee7bd2-111c-49a6-b391-230f954626e2 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] [instance: 27044daa-50a4-42de-b2e9-d5dbf7a62e75] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:41.438484 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d8ee7bd2-111c-49a6-b391-230f954626e2 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:41.439157 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d8ee7bd2-111c-49a6-b391-230f954626e2 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:41.439732 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d8ee7bd2-111c-49a6-b391-230f954626e2 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:41.440581 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d8ee7bd2-111c-49a6-b391-230f954626e2 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:41.441064 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d8ee7bd2-111c-49a6-b391-230f954626e2 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:41.441546 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d8ee7bd2-111c-49a6-b391-230f954626e2 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:41.455954 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.wsgi [None req-d8ee7bd2-111c-49a6-b391-230f954626e2 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] HTTP exception thrown: Instance 27044daa-50a4-42de-b2e9-d5dbf7a62e75 could not be found. Sep 20 04:55:41.457649 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-d8ee7bd2-111c-49a6-b391-230f954626e2 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Request method failure captured: Sep 20 04:55:41.457649 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: request: GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75 HTTP/1.1 Sep 20 04:55:41.457649 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept: application/json Sep 20 04:55:41.457649 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept-Encoding: identity Sep 20 04:55:41.457649 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Connection: close Sep 20 04:55:41.457649 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Length: 0 Sep 20 04:55:41.457649 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Type: application/json Sep 20 04:55:41.457649 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Host: 10.222.0.27 Sep 20 04:55:41.457649 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Openstack-System-Scope: None Sep 20 04:55:41.457649 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: User-Agent: python-urllib3/1.26.12 Sep 20 04:55:41.457649 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Auth-Token: gAAAAABjKUestt6XIkiOcTgY0gscBI_Vgs6oS6Q7lUp98ZotGRUWyaY6jvCXc0vHFbXsqBGvjWAX8148PGn4w6hqgw9ba-M8I-UqQZiZ0VaaN49Ph4l8NyphlnuzdKmcguMU7Q_Hm0jfoBUeW6tfPxBLMaEsuC1qhON9of4E99WMS_0H-5Cpe5E Sep 20 04:55:41.457649 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Id: None Sep 20 04:55:41.457649 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Name: None Sep 20 04:55:41.457649 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Identity-Status: Confirmed Sep 20 04:55:41.457649 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Is-Admin-Project: True Sep 20 04:55:41.457649 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Id: default Sep 20 04:55:41.457649 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Name: Default Sep 20 04:55:41.457649 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Id: 2bf8a8097f514bd5b31f5962183fb471 Sep 20 04:55:41.457649 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Name: tempest-VolumesNegativeTest-1729132292 Sep 20 04:55:41.457649 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Role: reader,member Sep 20 04:55:41.457649 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Roles: reader,member Sep 20 04:55:41.459295 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2bf8a8097f514bd5b31f5962183fb471"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2bf8a8097f514bd5b31f5962183fb471"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2bf8a8097f514bd5b31f5962183fb471", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2bf8a8097f514bd5b31f5962183fb471"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 04:55:41.459295 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant: tempest-VolumesNegativeTest-1729132292 Sep 20 04:55:41.459295 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Id: 2bf8a8097f514bd5b31f5962183fb471 Sep 20 04:55:41.459295 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Name: tempest-VolumesNegativeTest-1729132292 Sep 20 04:55:41.459295 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User: tempest-VolumesNegativeTest-1729132292-project Sep 20 04:55:41.459295 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Id: default Sep 20 04:55:41.459295 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Name: Default Sep 20 04:55:41.459295 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Id: 58589e0cbfe84948bcdfb823502ec98d Sep 20 04:55:41.459295 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Name: tempest-VolumesNegativeTest-1729132292-project Sep 20 04:55:41.459295 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: method: > Sep 20 04:55:41.459295 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: exception: Instance 27044daa-50a4-42de-b2e9-d5dbf7a62e75 could not be found. Sep 20 04:55:41.459295 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: action_args: {'id': '27044daa-50a4-42de-b2e9-d5dbf7a62e75'} Sep 20 04:55:41.460239 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 04:55:41.460239 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:55:41.460239 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 04:55:41.460239 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 04:55:41.460239 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 04:55:41.460239 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 04:55:41.460239 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 04:55:41.460239 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 04:55:41.460239 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 04:55:41.460239 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 04:55:41.460239 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27044daa-50a4-42de-b2e9-d5dbf7a62e75 could not be found. Sep 20 04:55:41.460239 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:55:41.460239 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:55:41.460239 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:55:41.460239 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:55:41.460239 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:55:41.460239 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:55:41.460239 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 04:55:41.460239 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 04:55:41.460239 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 04:55:41.461708 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 04:55:41.461708 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 04:55:41.461708 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 04:55:41.461708 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 04:55:41.461708 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 04:55:41.461708 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 04:55:41.461708 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 04:55:41.461708 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27044daa-50a4-42de-b2e9-d5dbf7a62e75 could not be found. Sep 20 04:55:41.461708 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:55:41.461708 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:55:41.461708 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:55:41.461708 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:55:41.461708 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:55:41.461708 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:55:41.461708 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 04:55:41.461708 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 04:55:41.461708 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27044daa-50a4-42de-b2e9-d5dbf7a62e75 could not be found. Sep 20 04:55:41.461708 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:55:41.462819 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-d8ee7bd2-111c-49a6-b391-230f954626e2 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] Returning 404 to user: Instance 27044daa-50a4-42de-b2e9-d5dbf7a62e75 could not be found. {{(pid=126813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 04:55:41.462819 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-d8ee7bd2-111c-49a6-b391-230f954626e2 tempest-VolumesNegativeTest-1729132292 tempest-VolumesNegativeTest-1729132292-project] 10.222.0.27 "GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75" status: 404 len: 111 microversion: 2.1 time: 0.035402 Sep 20 04:55:41.462819 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 207/357] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:41 2022] GET /compute/v2.1/servers/27044daa-50a4-42de-b2e9-d5dbf7a62e75 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 20 04:55:41.466336 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-5149af29-c6e4-4d73-a221-ff5719b50cdd tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:41.467025 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-5149af29-c6e4-4d73-a221-ff5719b50cdd tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:41.473747 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5149af29-c6e4-4d73-a221-ff5719b50cdd tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:41.474236 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5149af29-c6e4-4d73-a221-ff5719b50cdd tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:41.474700 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5149af29-c6e4-4d73-a221-ff5719b50cdd tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:41.475478 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5149af29-c6e4-4d73-a221-ff5719b50cdd tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:41.475956 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5149af29-c6e4-4d73-a221-ff5719b50cdd tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:41.476462 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5149af29-c6e4-4d73-a221-ff5719b50cdd tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:41.507680 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-5149af29-c6e4-4d73-a221-ff5719b50cdd tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046419 Sep 20 04:55:41.508390 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 208/358] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Sep 20 04:55:41 2022] GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:55:41.769887 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-4aa0264a-37e9-4532-9331-6086d92169f3 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:41.770504 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-4aa0264a-37e9-4532-9331-6086d92169f3 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] [instance: f024434a-d44b-41f9-8818-da15a5d0a52d] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:41.776510 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4aa0264a-37e9-4532-9331-6086d92169f3 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:41.777024 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4aa0264a-37e9-4532-9331-6086d92169f3 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:41.777456 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4aa0264a-37e9-4532-9331-6086d92169f3 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:41.778142 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4aa0264a-37e9-4532-9331-6086d92169f3 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:41.778591 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4aa0264a-37e9-4532-9331-6086d92169f3 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:41.779022 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4aa0264a-37e9-4532-9331-6086d92169f3 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:41.792757 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.wsgi [None req-4aa0264a-37e9-4532-9331-6086d92169f3 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] HTTP exception thrown: Instance f024434a-d44b-41f9-8818-da15a5d0a52d could not be found. Sep 20 04:55:41.794303 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-4aa0264a-37e9-4532-9331-6086d92169f3 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Request method failure captured: Sep 20 04:55:41.794303 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: request: GET /compute/v2.1/servers/f024434a-d44b-41f9-8818-da15a5d0a52d HTTP/1.1 Sep 20 04:55:41.794303 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept: application/json Sep 20 04:55:41.794303 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept-Encoding: identity Sep 20 04:55:41.794303 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Connection: close Sep 20 04:55:41.794303 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Length: 0 Sep 20 04:55:41.794303 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Type: application/json Sep 20 04:55:41.794303 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Host: 10.222.0.27 Sep 20 04:55:41.794303 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Openstack-System-Scope: None Sep 20 04:55:41.794303 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: User-Agent: python-urllib3/1.26.12 Sep 20 04:55:41.794303 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Auth-Token: gAAAAABjKUd5he8Od3uPWtcdMRy0wEnVrfT2OkG6aq5GDRuRylJ2VONMNWLgnc7Xf4tjlmODucdoyKBSLioDnQ0F3tyfuQqpcMGc2JyvRH8KYwZkpA00UdWWrwxidQL5Wl_5S_39qD_v5cEta1MBlJJtA7M78x6qnB4-xXKZd9Cyu6TGkYQkaKQ Sep 20 04:55:41.794303 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Id: None Sep 20 04:55:41.794303 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Name: None Sep 20 04:55:41.794303 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Identity-Status: Confirmed Sep 20 04:55:41.794303 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Is-Admin-Project: True Sep 20 04:55:41.794303 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Id: default Sep 20 04:55:41.794303 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Name: Default Sep 20 04:55:41.794303 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Id: 725d386301d648de85fd6c4767250c58 Sep 20 04:55:41.794303 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Name: tempest-VolumesSnapshotTestJSON-315607713 Sep 20 04:55:41.794303 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Role: reader,member Sep 20 04:55:41.794303 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Roles: reader,member Sep 20 04:55:41.795740 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/725d386301d648de85fd6c4767250c58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/725d386301d648de85fd6c4767250c58"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_725d386301d648de85fd6c4767250c58", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/725d386301d648de85fd6c4767250c58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 04:55:41.795740 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant: tempest-VolumesSnapshotTestJSON-315607713 Sep 20 04:55:41.795740 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Id: 725d386301d648de85fd6c4767250c58 Sep 20 04:55:41.795740 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-315607713 Sep 20 04:55:41.795740 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User: tempest-VolumesSnapshotTestJSON-315607713-project Sep 20 04:55:41.795740 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Id: default Sep 20 04:55:41.795740 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Name: Default Sep 20 04:55:41.795740 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Id: b3d877f0c71f4e18854813780214ed6a Sep 20 04:55:41.795740 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Name: tempest-VolumesSnapshotTestJSON-315607713-project Sep 20 04:55:41.795740 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: method: > Sep 20 04:55:41.795740 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: exception: Instance f024434a-d44b-41f9-8818-da15a5d0a52d could not be found. Sep 20 04:55:41.795740 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: action_args: {'id': 'f024434a-d44b-41f9-8818-da15a5d0a52d'} Sep 20 04:55:41.796516 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 04:55:41.796516 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:55:41.796516 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 04:55:41.796516 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 04:55:41.796516 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 04:55:41.796516 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 04:55:41.796516 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 04:55:41.796516 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 04:55:41.796516 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 04:55:41.796516 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 04:55:41.796516 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f024434a-d44b-41f9-8818-da15a5d0a52d could not be found. Sep 20 04:55:41.796516 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:55:41.796516 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:55:41.796516 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:55:41.796516 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:55:41.796516 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:55:41.796516 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:55:41.796516 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 04:55:41.796516 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 04:55:41.796516 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 04:55:41.797742 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 04:55:41.797742 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 04:55:41.797742 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 04:55:41.797742 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 04:55:41.797742 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 04:55:41.797742 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 04:55:41.797742 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 04:55:41.797742 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f024434a-d44b-41f9-8818-da15a5d0a52d could not be found. Sep 20 04:55:41.797742 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:55:41.797742 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:55:41.797742 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:55:41.797742 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:55:41.797742 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:55:41.797742 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:55:41.797742 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 04:55:41.797742 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 04:55:41.797742 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f024434a-d44b-41f9-8818-da15a5d0a52d could not be found. Sep 20 04:55:41.797742 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:55:41.799315 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-4aa0264a-37e9-4532-9331-6086d92169f3 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Returning 404 to user: Instance f024434a-d44b-41f9-8818-da15a5d0a52d could not be found. {{(pid=126813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 04:55:41.799315 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-4aa0264a-37e9-4532-9331-6086d92169f3 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] 10.222.0.27 "GET /compute/v2.1/servers/f024434a-d44b-41f9-8818-da15a5d0a52d" status: 404 len: 111 microversion: 2.1 time: 0.030458 Sep 20 04:55:41.799315 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 209/359] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:41 2022] GET /compute/v2.1/servers/f024434a-d44b-41f9-8818-da15a5d0a52d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 20 04:55:42.520082 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-d9c6834b-2c5d-4555-8a09-3712605bf315 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:42.522316 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-d9c6834b-2c5d-4555-8a09-3712605bf315 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:42.529029 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d9c6834b-2c5d-4555-8a09-3712605bf315 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:42.529692 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d9c6834b-2c5d-4555-8a09-3712605bf315 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:42.530146 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d9c6834b-2c5d-4555-8a09-3712605bf315 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:42.530922 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d9c6834b-2c5d-4555-8a09-3712605bf315 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:42.531366 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d9c6834b-2c5d-4555-8a09-3712605bf315 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:42.531834 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d9c6834b-2c5d-4555-8a09-3712605bf315 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:42.563153 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-d9c6834b-2c5d-4555-8a09-3712605bf315 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046789 Sep 20 04:55:42.563714 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 210/360] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Sep 20 04:55:42 2022] GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 04:55:43.575278 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-3f4fc121-a31e-40a3-a8db-30144a5509eb tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:43.577393 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-3f4fc121-a31e-40a3-a8db-30144a5509eb tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:43.583821 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3f4fc121-a31e-40a3-a8db-30144a5509eb tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:43.584299 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3f4fc121-a31e-40a3-a8db-30144a5509eb tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:43.584769 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3f4fc121-a31e-40a3-a8db-30144a5509eb tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:43.585462 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3f4fc121-a31e-40a3-a8db-30144a5509eb tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:43.585913 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3f4fc121-a31e-40a3-a8db-30144a5509eb tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:43.586335 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3f4fc121-a31e-40a3-a8db-30144a5509eb tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:43.616380 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-3f4fc121-a31e-40a3-a8db-30144a5509eb tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045058 Sep 20 04:55:43.616969 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 211/361] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Sep 20 04:55:43 2022] GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 04:55:44.629382 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-f8882c26-1f4f-4d07-aa7c-55b7d399b7b6 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:44.631527 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-f8882c26-1f4f-4d07-aa7c-55b7d399b7b6 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:44.637902 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f8882c26-1f4f-4d07-aa7c-55b7d399b7b6 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:44.638376 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f8882c26-1f4f-4d07-aa7c-55b7d399b7b6 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:44.638809 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f8882c26-1f4f-4d07-aa7c-55b7d399b7b6 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:44.639481 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f8882c26-1f4f-4d07-aa7c-55b7d399b7b6 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:44.639929 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f8882c26-1f4f-4d07-aa7c-55b7d399b7b6 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:44.640936 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f8882c26-1f4f-4d07-aa7c-55b7d399b7b6 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:44.670714 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-f8882c26-1f4f-4d07-aa7c-55b7d399b7b6 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045825 Sep 20 04:55:44.671252 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 212/362] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Sep 20 04:55:44 2022] GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 04:55:45.683386 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-0c6645da-d775-4e90-8d38-85d4e9333517 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:45.685536 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-0c6645da-d775-4e90-8d38-85d4e9333517 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:45.692455 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0c6645da-d775-4e90-8d38-85d4e9333517 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:45.692961 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0c6645da-d775-4e90-8d38-85d4e9333517 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:45.693390 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0c6645da-d775-4e90-8d38-85d4e9333517 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:45.694065 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0c6645da-d775-4e90-8d38-85d4e9333517 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:45.694511 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0c6645da-d775-4e90-8d38-85d4e9333517 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:45.694935 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0c6645da-d775-4e90-8d38-85d4e9333517 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:45.722978 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-0c6645da-d775-4e90-8d38-85d4e9333517 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043589 Sep 20 04:55:45.723515 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 213/363] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Sep 20 04:55:45 2022] GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 20 04:55:45.785745 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-b49ed5aa-3773-4372-b3e7-def92a378995 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:45.786239 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-b49ed5aa-3773-4372-b3e7-def92a378995 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:45.792056 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b49ed5aa-3773-4372-b3e7-def92a378995 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:45.792531 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b49ed5aa-3773-4372-b3e7-def92a378995 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:45.793063 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b49ed5aa-3773-4372-b3e7-def92a378995 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:45.793745 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b49ed5aa-3773-4372-b3e7-def92a378995 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:45.794189 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b49ed5aa-3773-4372-b3e7-def92a378995 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:45.794607 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b49ed5aa-3773-4372-b3e7-def92a378995 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:45.821654 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-b49ed5aa-3773-4372-b3e7-def92a378995 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Going to try to terminate instance {{(pid=126813) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 20 04:55:45.895459 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-b49ed5aa-3773-4372-b3e7-def92a378995 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab" status: 204 len: 0 microversion: 2.1 time: 0.113170 Sep 20 04:55:45.896072 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 214/364] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Sep 20 04:55:45 2022] DELETE /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 20 04:55:45.905435 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-e6a7e6cd-a72b-4b3e-aeb6-648a29b2e29a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:45.906643 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-e6a7e6cd-a72b-4b3e-aeb6-648a29b2e29a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:45.912345 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e6a7e6cd-a72b-4b3e-aeb6-648a29b2e29a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:45.912855 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e6a7e6cd-a72b-4b3e-aeb6-648a29b2e29a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:45.913287 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e6a7e6cd-a72b-4b3e-aeb6-648a29b2e29a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:45.913965 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e6a7e6cd-a72b-4b3e-aeb6-648a29b2e29a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:45.914416 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e6a7e6cd-a72b-4b3e-aeb6-648a29b2e29a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:45.914836 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e6a7e6cd-a72b-4b3e-aeb6-648a29b2e29a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:46.044663 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-e6a7e6cd-a72b-4b3e-aeb6-648a29b2e29a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:55:46.053257 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-e6a7e6cd-a72b-4b3e-aeb6-648a29b2e29a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab" status: 200 len: 1682 microversion: 2.1 time: 0.151994 Sep 20 04:55:46.053848 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 215/365] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:45 2022] GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:55:47.078053 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-be2efb5a-6b4b-4f89-8e4f-71ea37fe0fdb tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:47.078705 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-be2efb5a-6b4b-4f89-8e4f-71ea37fe0fdb tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:47.085023 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-be2efb5a-6b4b-4f89-8e4f-71ea37fe0fdb tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:47.085508 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-be2efb5a-6b4b-4f89-8e4f-71ea37fe0fdb tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:47.086070 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-be2efb5a-6b4b-4f89-8e4f-71ea37fe0fdb tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:47.086776 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-be2efb5a-6b4b-4f89-8e4f-71ea37fe0fdb tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:47.087231 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-be2efb5a-6b4b-4f89-8e4f-71ea37fe0fdb tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:47.087653 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-be2efb5a-6b4b-4f89-8e4f-71ea37fe0fdb tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:47.226405 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-be2efb5a-6b4b-4f89-8e4f-71ea37fe0fdb tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:55:47.234806 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-be2efb5a-6b4b-4f89-8e4f-71ea37fe0fdb tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab" status: 200 len: 1682 microversion: 2.1 time: 0.161524 Sep 20 04:55:47.235411 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 216/366] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:47 2022] GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:55:48.258331 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-239ca754-03f7-4e8b-9268-a5e9fab17a76 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:48.259670 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-239ca754-03f7-4e8b-9268-a5e9fab17a76 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:48.267371 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-239ca754-03f7-4e8b-9268-a5e9fab17a76 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:48.268382 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-239ca754-03f7-4e8b-9268-a5e9fab17a76 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:48.269009 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-239ca754-03f7-4e8b-9268-a5e9fab17a76 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:48.269913 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-239ca754-03f7-4e8b-9268-a5e9fab17a76 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:48.270556 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-239ca754-03f7-4e8b-9268-a5e9fab17a76 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:48.271141 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-239ca754-03f7-4e8b-9268-a5e9fab17a76 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:48.411614 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-239ca754-03f7-4e8b-9268-a5e9fab17a76 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:55:48.418519 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:55:48.428554 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-239ca754-03f7-4e8b-9268-a5e9fab17a76 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab" status: 200 len: 1682 microversion: 2.1 time: 0.173836 Sep 20 04:55:48.429514 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 217/367] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:48 2022] GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:55:48.434528 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-918d230f-9182-49d1-bd1c-5ce554225cad tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6b33c1f-e645-4e15-9aec-ec8a988a485d"}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:55:48.437075 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-918d230f-9182-49d1-bd1c-5ce554225cad tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:48.449095 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-918d230f-9182-49d1-bd1c-5ce554225cad tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:48.450095 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-918d230f-9182-49d1-bd1c-5ce554225cad tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:48.450554 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-918d230f-9182-49d1-bd1c-5ce554225cad tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:48.451282 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-918d230f-9182-49d1-bd1c-5ce554225cad tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:48.452400 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-918d230f-9182-49d1-bd1c-5ce554225cad tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:48.453401 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-918d230f-9182-49d1-bd1c-5ce554225cad tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:49.643490 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-918d230f-9182-49d1-bd1c-5ce554225cad tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "POST /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.212466 Sep 20 04:55:49.650040 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 218/368] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Sep 20 04:55:48 2022] POST /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906/os-volume_attachments => generated 194 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:55:49.655174 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-ab9c0884-d091-401d-bf64-7d18847695ed tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:49.656451 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-ab9c0884-d091-401d-bf64-7d18847695ed tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:49.663501 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ab9c0884-d091-401d-bf64-7d18847695ed tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:49.664007 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ab9c0884-d091-401d-bf64-7d18847695ed tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:49.664450 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ab9c0884-d091-401d-bf64-7d18847695ed tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:49.665475 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ab9c0884-d091-401d-bf64-7d18847695ed tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:49.665940 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ab9c0884-d091-401d-bf64-7d18847695ed tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:49.666399 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ab9c0884-d091-401d-bf64-7d18847695ed tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:49.899815 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-ab9c0884-d091-401d-bf64-7d18847695ed tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:55:49.910810 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-ab9c0884-d091-401d-bf64-7d18847695ed tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab" status: 200 len: 1682 microversion: 2.1 time: 0.265303 Sep 20 04:55:49.911787 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 219/369] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:49 2022] GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab => generated 1682 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:55:49.993633 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-7221182a-5ad1-45cc-9a54-e97516042e9f tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1905268826", "imageRef": "080ea053-830e-4470-a886-0ab99b0ab3e0", "flavorRef": "452", "networks": [{"uuid": "5a2e8ba6-6e30-4ff7-bf9d-8b3fbb5df340"}]}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:55:50.068407 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.network.neutron [None req-7221182a-5ad1-45cc-9a54-e97516042e9f tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] validate_networks() for [('5a2e8ba6-6e30-4ff7-bf9d-8b3fbb5df340', None, None, None, None, None)] {{(pid=126813) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 20 04:55:51.321195 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-7221182a-5ad1-45cc-9a54-e97516042e9f tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Flavor limits 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 20 04:55:51.321841 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-7221182a-5ad1-45cc-9a54-e97516042e9f tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Image limits 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 20 04:55:51.322452 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-7221182a-5ad1-45cc-9a54-e97516042e9f tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Flavor pref 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 20 04:55:51.322955 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-7221182a-5ad1-45cc-9a54-e97516042e9f tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Image pref 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 20 04:55:51.323600 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-7221182a-5ad1-45cc-9a54-e97516042e9f tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 20 04:55:51.335035 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7221182a-5ad1-45cc-9a54-e97516042e9f tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:51.335705 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7221182a-5ad1-45cc-9a54-e97516042e9f tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:51.336359 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7221182a-5ad1-45cc-9a54-e97516042e9f tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:51.337240 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7221182a-5ad1-45cc-9a54-e97516042e9f tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:51.338006 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7221182a-5ad1-45cc-9a54-e97516042e9f tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:51.338538 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7221182a-5ad1-45cc-9a54-e97516042e9f tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:51.359478 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-7221182a-5ad1-45cc-9a54-e97516042e9f tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Getting quotas for project 725d386301d648de85fd6c4767250c58. Resources: {'ram', 'cores', 'instances'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 04:55:51.364478 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-7221182a-5ad1-45cc-9a54-e97516042e9f tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Getting quotas for user b3d877f0c71f4e18854813780214ed6a and project 725d386301d648de85fd6c4767250c58. Resources: {'ram', 'cores', 'instances'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 04:55:51.377539 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-7221182a-5ad1-45cc-9a54-e97516042e9f tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Going to run 1 instances... {{(pid=126813) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 20 04:55:51.380371 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-7221182a-5ad1-45cc-9a54-e97516042e9f tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] [instance: d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='080ea053-830e-4470-a886-0ab99b0ab3e0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126813) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 20 04:55:51.408447 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:55:51.430456 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-7221182a-5ad1-45cc-9a54-e97516042e9f tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.442044 Sep 20 04:55:51.431244 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 220/370] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Sep 20 04:55:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1443 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 20 04:55:51.436017 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-9e9f50bd-4ad7-40b5-b14d-d23efb3d7ad5 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:51.436776 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-9e9f50bd-4ad7-40b5-b14d-d23efb3d7ad5 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:51.444533 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9e9f50bd-4ad7-40b5-b14d-d23efb3d7ad5 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:51.445049 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9e9f50bd-4ad7-40b5-b14d-d23efb3d7ad5 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:51.445488 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9e9f50bd-4ad7-40b5-b14d-d23efb3d7ad5 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:51.446190 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9e9f50bd-4ad7-40b5-b14d-d23efb3d7ad5 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:51.446819 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9e9f50bd-4ad7-40b5-b14d-d23efb3d7ad5 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:51.447405 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9e9f50bd-4ad7-40b5-b14d-d23efb3d7ad5 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:51.749418 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-9e9f50bd-4ad7-40b5-b14d-d23efb3d7ad5 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:55:51.758400 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-9e9f50bd-4ad7-40b5-b14d-d23efb3d7ad5 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab" status: 200 len: 1682 microversion: 2.1 time: 0.325831 Sep 20 04:55:51.758974 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 221/371] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:51 2022] GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab => generated 1682 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:55:51.764685 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-291fbf15-3e66-421f-b972-80f59f0f8dfc tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:51.765830 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-291fbf15-3e66-421f-b972-80f59f0f8dfc tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] [instance: d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:51.847678 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-291fbf15-3e66-421f-b972-80f59f0f8dfc tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d877f0c71f4e18854813780214ed6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725d386301d648de85fd6c4767250c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:55:51.857650 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-291fbf15-3e66-421f-b972-80f59f0f8dfc tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] 10.222.0.27 "GET /compute/v2.1/servers/d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d" status: 200 len: 1219 microversion: 2.1 time: 0.097433 Sep 20 04:55:51.863007 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 222/372] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:51 2022] GET /compute/v2.1/servers/d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d => generated 1219 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:55:52.239134 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-107bc54f-e235-472d-8855-0f5db0982dec req-fae83516-6cac-4373-9bc4-7cf31467761f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7723784c-51e5-4936-b33a-caf9b1b87bab", "name": "network-vif-deleted", "tag": "4e821eae-4814-40c5-b31f-2ea37b73d8f1"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:55:52.257060 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-107bc54f-e235-472d-8855-0f5db0982dec req-fae83516-6cac-4373-9bc4-7cf31467761f service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:52.259414 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-107bc54f-e235-472d-8855-0f5db0982dec req-fae83516-6cac-4373-9bc4-7cf31467761f service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:52.260219 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-107bc54f-e235-472d-8855-0f5db0982dec req-fae83516-6cac-4373-9bc4-7cf31467761f service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:52.291479 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-107bc54f-e235-472d-8855-0f5db0982dec req-fae83516-6cac-4373-9bc4-7cf31467761f service nova] Creating event network-vif-deleted:4e821eae-4814-40c5-b31f-2ea37b73d8f1 for instance 7723784c-51e5-4936-b33a-caf9b1b87bab on hv-cinder-75671 Sep 20 04:55:52.301612 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-107bc54f-e235-472d-8855-0f5db0982dec req-fae83516-6cac-4373-9bc4-7cf31467761f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067642 Sep 20 04:55:52.302228 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 223/373] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 04:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 04:55:52.790633 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-5cf0e14f-21e0-4a3f-98d0-7835ad1f64a1 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:52.791905 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-5cf0e14f-21e0-4a3f-98d0-7835ad1f64a1 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:52.809108 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5cf0e14f-21e0-4a3f-98d0-7835ad1f64a1 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:52.810182 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5cf0e14f-21e0-4a3f-98d0-7835ad1f64a1 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:52.810790 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5cf0e14f-21e0-4a3f-98d0-7835ad1f64a1 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:52.812528 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5cf0e14f-21e0-4a3f-98d0-7835ad1f64a1 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:52.813894 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5cf0e14f-21e0-4a3f-98d0-7835ad1f64a1 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:52.814941 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5cf0e14f-21e0-4a3f-98d0-7835ad1f64a1 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:52.906393 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5cf0e14f-21e0-4a3f-98d0-7835ad1f64a1 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:52.907253 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5cf0e14f-21e0-4a3f-98d0-7835ad1f64a1 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:52.908011 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5cf0e14f-21e0-4a3f-98d0-7835ad1f64a1 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:52.908879 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.objects.instance [None req-5cf0e14f-21e0-4a3f-98d0-7835ad1f64a1 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lazy-loading 'fault' on Instance uuid 7723784c-51e5-4936-b33a-caf9b1b87bab {{(pid=126813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 04:55:53.003806 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-5cf0e14f-21e0-4a3f-98d0-7835ad1f64a1 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:55:53.012857 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-5cf0e14f-21e0-4a3f-98d0-7835ad1f64a1 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab" status: 200 len: 1332 microversion: 2.1 time: 0.231434 Sep 20 04:55:53.021235 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 224/374] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:52 2022] GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab => generated 1332 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:55:53.025971 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-87817767-28af-474f-ae39-11612e8ef346 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:53.026579 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-87817767-28af-474f-ae39-11612e8ef346 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] [instance: d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:53.042172 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-87817767-28af-474f-ae39-11612e8ef346 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:53.042682 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-87817767-28af-474f-ae39-11612e8ef346 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:53.044982 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-87817767-28af-474f-ae39-11612e8ef346 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:53.046524 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-87817767-28af-474f-ae39-11612e8ef346 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:53.048923 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-87817767-28af-474f-ae39-11612e8ef346 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:53.050934 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-87817767-28af-474f-ae39-11612e8ef346 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:53.545389 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-87817767-28af-474f-ae39-11612e8ef346 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d877f0c71f4e18854813780214ed6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725d386301d648de85fd6c4767250c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:55:53.555072 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-87817767-28af-474f-ae39-11612e8ef346 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] 10.222.0.27 "GET /compute/v2.1/servers/d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d" status: 200 len: 1279 microversion: 2.1 time: 0.532742 Sep 20 04:55:53.566766 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 225/375] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:53 2022] GET /compute/v2.1/servers/d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d => generated 1279 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:55:54.038140 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-2eda1a24-1e76-4e66-9e9f-75b88f19510a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:54.039834 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-2eda1a24-1e76-4e66-9e9f-75b88f19510a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:54.050835 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2eda1a24-1e76-4e66-9e9f-75b88f19510a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:54.058032 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2eda1a24-1e76-4e66-9e9f-75b88f19510a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:54.059078 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2eda1a24-1e76-4e66-9e9f-75b88f19510a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:54.060203 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2eda1a24-1e76-4e66-9e9f-75b88f19510a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:54.063427 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2eda1a24-1e76-4e66-9e9f-75b88f19510a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:54.064157 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2eda1a24-1e76-4e66-9e9f-75b88f19510a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:54.092425 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.wsgi [None req-2eda1a24-1e76-4e66-9e9f-75b88f19510a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] HTTP exception thrown: Instance 7723784c-51e5-4936-b33a-caf9b1b87bab could not be found. Sep 20 04:55:54.095082 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-2eda1a24-1e76-4e66-9e9f-75b88f19510a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Request method failure captured: Sep 20 04:55:54.095082 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: request: GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab HTTP/1.1 Sep 20 04:55:54.095082 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept: application/json Sep 20 04:55:54.095082 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept-Encoding: identity Sep 20 04:55:54.095082 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Connection: close Sep 20 04:55:54.095082 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Length: 0 Sep 20 04:55:54.095082 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Type: application/json Sep 20 04:55:54.095082 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Host: 10.222.0.27 Sep 20 04:55:54.095082 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Openstack-System-Scope: None Sep 20 04:55:54.095082 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: User-Agent: python-urllib3/1.26.12 Sep 20 04:55:54.095082 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Auth-Token: gAAAAABjKUbv3hCswc9OTl1x4i1QFI6XV3GUT2FYN7UTgjG9dzuM3jqx_GcwO4w0JWwRz9sTS2WwajnGfx2wJ2_1hAz4UUEc_snPtCtdpEIJJc5Fb8lrnltNsG7f_iYNiB6Uy9F1dOvGdMIHwFbxpPMJ6tdvqkqh2eaYhvMGxVgemwP0gnqQm2U Sep 20 04:55:54.095082 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Id: None Sep 20 04:55:54.095082 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Name: None Sep 20 04:55:54.095082 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Identity-Status: Confirmed Sep 20 04:55:54.095082 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Is-Admin-Project: True Sep 20 04:55:54.095082 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Id: default Sep 20 04:55:54.095082 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Name: Default Sep 20 04:55:54.095082 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Id: 4f0f0b8842ae496292c27a6ee1350d32 Sep 20 04:55:54.095082 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Name: tempest-AttachVolumeNegativeTest-1482924724 Sep 20 04:55:54.095082 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Role: reader,member Sep 20 04:55:54.095082 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Roles: reader,member Sep 20 04:55:54.097274 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f0f0b8842ae496292c27a6ee1350d32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f0f0b8842ae496292c27a6ee1350d32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4f0f0b8842ae496292c27a6ee1350d32", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4f0f0b8842ae496292c27a6ee1350d32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 04:55:54.097274 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant: tempest-AttachVolumeNegativeTest-1482924724 Sep 20 04:55:54.097274 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Id: 4f0f0b8842ae496292c27a6ee1350d32 Sep 20 04:55:54.097274 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1482924724 Sep 20 04:55:54.097274 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User: tempest-AttachVolumeNegativeTest-1482924724-project Sep 20 04:55:54.097274 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Id: default Sep 20 04:55:54.097274 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Name: Default Sep 20 04:55:54.097274 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Id: c93f22104a7b4a7caf0cc8b7180ffc55 Sep 20 04:55:54.097274 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Name: tempest-AttachVolumeNegativeTest-1482924724-project Sep 20 04:55:54.097274 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: method: > Sep 20 04:55:54.097274 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: exception: Instance 7723784c-51e5-4936-b33a-caf9b1b87bab could not be found. Sep 20 04:55:54.097274 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: action_args: {'id': '7723784c-51e5-4936-b33a-caf9b1b87bab'} Sep 20 04:55:54.099216 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 04:55:54.099216 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:55:54.099216 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 04:55:54.099216 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 04:55:54.099216 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 04:55:54.099216 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 04:55:54.099216 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 04:55:54.099216 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 04:55:54.099216 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 04:55:54.099216 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 04:55:54.099216 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7723784c-51e5-4936-b33a-caf9b1b87bab could not be found. Sep 20 04:55:54.099216 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:55:54.099216 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:55:54.099216 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:55:54.099216 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:55:54.099216 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:55:54.099216 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:55:54.099216 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 04:55:54.099216 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 04:55:54.099216 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 04:55:54.101363 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 04:55:54.101363 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 04:55:54.101363 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 04:55:54.101363 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 04:55:54.101363 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 04:55:54.101363 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 04:55:54.101363 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 04:55:54.101363 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7723784c-51e5-4936-b33a-caf9b1b87bab could not be found. Sep 20 04:55:54.101363 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:55:54.101363 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:55:54.101363 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:55:54.101363 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:55:54.101363 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:55:54.101363 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:55:54.101363 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 04:55:54.101363 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 04:55:54.101363 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7723784c-51e5-4936-b33a-caf9b1b87bab could not be found. Sep 20 04:55:54.101363 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:55:54.114893 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-2eda1a24-1e76-4e66-9e9f-75b88f19510a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Returning 404 to user: Instance 7723784c-51e5-4936-b33a-caf9b1b87bab could not be found. {{(pid=126813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 04:55:54.126269 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-2eda1a24-1e76-4e66-9e9f-75b88f19510a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab" status: 404 len: 111 microversion: 2.1 time: 0.091931 Sep 20 04:55:54.135837 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 226/376] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:54 2022] GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 20 04:55:54.144105 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-4e23c00b-0a4d-405d-a308-175693593792 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '.version_select at 0x7f2e4a620160>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:54.178468 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-4e23c00b-0a4d-405d-a308-175693593792 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1936133408" status: 202 len: 0 microversion: 2.1 time: 0.041112 Sep 20 04:55:54.187613 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 227/377] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Sep 20 04:55:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1936133408 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 20 04:55:54.594492 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-2eed1846-528a-4f73-b22c-54d1d97d87aa tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:54.595449 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-2eed1846-528a-4f73-b22c-54d1d97d87aa tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] [instance: d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:54.605853 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2eed1846-528a-4f73-b22c-54d1d97d87aa tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:54.606454 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2eed1846-528a-4f73-b22c-54d1d97d87aa tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:54.607339 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2eed1846-528a-4f73-b22c-54d1d97d87aa tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:54.610089 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2eed1846-528a-4f73-b22c-54d1d97d87aa tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:54.610683 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2eed1846-528a-4f73-b22c-54d1d97d87aa tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:54.611695 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2eed1846-528a-4f73-b22c-54d1d97d87aa tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:55.043782 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-2eed1846-528a-4f73-b22c-54d1d97d87aa tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d877f0c71f4e18854813780214ed6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725d386301d648de85fd6c4767250c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:55:55.057538 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-2eed1846-528a-4f73-b22c-54d1d97d87aa tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] 10.222.0.27 "GET /compute/v2.1/servers/d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d" status: 200 len: 1319 microversion: 2.1 time: 0.467569 Sep 20 04:55:55.058387 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 228/378] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:54 2022] GET /compute/v2.1/servers/d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d => generated 1319 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:55:55.068980 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-08b0a0c4-e8ae-4afe-98bc-5e30d799c1b9 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Action: 'create', calling method: .version_select at 0x7f2e4a66eee0>, body: {"keypair": {"name": "tempest-keypair-126007507", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHqOQeuadBfOsTDahJ58HEXPZujlnA9o0j8xk2Nx/0Qm8O/VHUrUUnwCL39iajvCpO9+zQ5jmqCsnaGddwsTilHV7qGcTMnyV17eZJtl8NTS3yge4D7qplZ3m+Xdl5FnQA=="}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:55:55.088863 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-08b0a0c4-e8ae-4afe-98bc-5e30d799c1b9 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Getting quotas for project 4f0f0b8842ae496292c27a6ee1350d32. Resources: {'key_pairs'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 04:55:55.094886 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-08b0a0c4-e8ae-4afe-98bc-5e30d799c1b9 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Getting quotas for user c93f22104a7b4a7caf0cc8b7180ffc55 and project 4f0f0b8842ae496292c27a6ee1350d32. Resources: {'key_pairs'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 04:55:55.118904 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-08b0a0c4-e8ae-4afe-98bc-5e30d799c1b9 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.059344 Sep 20 04:55:55.119509 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 229/379] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Sep 20 04:55:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:55:55.822594 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-81f83672-4158-4ffb-a584-f9296dd222a8 req-f78b9555-a696-48fc-beeb-f6ca81507abb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d", "tag": "31e662db-2a8c-47a3-862e-c1f0f71c017f"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:55:55.848768 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-81f83672-4158-4ffb-a584-f9296dd222a8 req-f78b9555-a696-48fc-beeb-f6ca81507abb service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:55.851376 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-81f83672-4158-4ffb-a584-f9296dd222a8 req-f78b9555-a696-48fc-beeb-f6ca81507abb service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:55.851931 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-81f83672-4158-4ffb-a584-f9296dd222a8 req-f78b9555-a696-48fc-beeb-f6ca81507abb service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:55.879440 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-81f83672-4158-4ffb-a584-f9296dd222a8 req-f78b9555-a696-48fc-beeb-f6ca81507abb service nova] Creating event network-changed:31e662db-2a8c-47a3-862e-c1f0f71c017f for instance d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d on hv-cinder-75671 Sep 20 04:55:55.894805 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-81f83672-4158-4ffb-a584-f9296dd222a8 req-f78b9555-a696-48fc-beeb-f6ca81507abb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077500 Sep 20 04:55:55.896454 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 230/380] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 04:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 04:55:56.081913 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-da3e15c5-4d5f-48fa-a2e8-7310bf7ec179 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:56.082625 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-da3e15c5-4d5f-48fa-a2e8-7310bf7ec179 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] [instance: d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:56.097244 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-da3e15c5-4d5f-48fa-a2e8-7310bf7ec179 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:56.098968 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-da3e15c5-4d5f-48fa-a2e8-7310bf7ec179 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:56.100651 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-da3e15c5-4d5f-48fa-a2e8-7310bf7ec179 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:56.101724 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-da3e15c5-4d5f-48fa-a2e8-7310bf7ec179 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:56.102190 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-da3e15c5-4d5f-48fa-a2e8-7310bf7ec179 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:56.103223 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-da3e15c5-4d5f-48fa-a2e8-7310bf7ec179 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:56.345802 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-da3e15c5-4d5f-48fa-a2e8-7310bf7ec179 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d877f0c71f4e18854813780214ed6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725d386301d648de85fd6c4767250c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:55:56.354066 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-da3e15c5-4d5f-48fa-a2e8-7310bf7ec179 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] 10.222.0.27 "GET /compute/v2.1/servers/d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d" status: 200 len: 1319 microversion: 2.1 time: 0.277123 Sep 20 04:55:56.354712 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 231/381] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:56 2022] GET /compute/v2.1/servers/d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d => generated 1319 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:55:57.380199 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-d8a4b571-3724-4abb-af7d-979eec3a0b28 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:57.380850 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-d8a4b571-3724-4abb-af7d-979eec3a0b28 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] [instance: d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:57.394564 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d8a4b571-3724-4abb-af7d-979eec3a0b28 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:57.395646 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d8a4b571-3724-4abb-af7d-979eec3a0b28 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:57.398649 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d8a4b571-3724-4abb-af7d-979eec3a0b28 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:57.399901 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d8a4b571-3724-4abb-af7d-979eec3a0b28 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:57.401015 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d8a4b571-3724-4abb-af7d-979eec3a0b28 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:57.401841 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d8a4b571-3724-4abb-af7d-979eec3a0b28 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:57.599210 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-d8a4b571-3724-4abb-af7d-979eec3a0b28 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d877f0c71f4e18854813780214ed6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725d386301d648de85fd6c4767250c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:55:57.609930 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-d8a4b571-3724-4abb-af7d-979eec3a0b28 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] 10.222.0.27 "GET /compute/v2.1/servers/d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d" status: 200 len: 1319 microversion: 2.1 time: 0.236476 Sep 20 04:55:57.625546 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 232/382] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:57 2022] GET /compute/v2.1/servers/d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:55:57.634434 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-a19eba54-596c-46c6-9411-f0f5bd6c8fbd tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:55:57.637440 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-a19eba54-596c-46c6-9411-f0f5bd6c8fbd tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:57.645658 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a19eba54-596c-46c6-9411-f0f5bd6c8fbd tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:57.646384 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a19eba54-596c-46c6-9411-f0f5bd6c8fbd tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:57.647011 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a19eba54-596c-46c6-9411-f0f5bd6c8fbd tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:57.647915 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a19eba54-596c-46c6-9411-f0f5bd6c8fbd tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:57.648727 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a19eba54-596c-46c6-9411-f0f5bd6c8fbd tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:57.649312 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a19eba54-596c-46c6-9411-f0f5bd6c8fbd tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:57.676713 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.objects.instance [None req-a19eba54-596c-46c6-9411-f0f5bd6c8fbd tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lazy-loading 'flavor' on Instance uuid 8df00208-8207-4ff8-9979-2e00926de906 {{(pid=126813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 04:55:57.835141 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-a19eba54-596c-46c6-9411-f0f5bd6c8fbd tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "POST /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906/action" status: 200 len: 32 microversion: 2.1 time: 0.207943 Sep 20 04:55:57.836761 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 233/383] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Sep 20 04:55:57 2022] POST /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906/action => generated 32 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 20 04:55:57.851130 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-f1dc63bf-aa04-43d8-b124-4cad944f71ba tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:57.851982 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-f1dc63bf-aa04-43d8-b124-4cad944f71ba tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:57.860101 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f1dc63bf-aa04-43d8-b124-4cad944f71ba tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:57.860825 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f1dc63bf-aa04-43d8-b124-4cad944f71ba tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:57.861452 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f1dc63bf-aa04-43d8-b124-4cad944f71ba tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:57.862585 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f1dc63bf-aa04-43d8-b124-4cad944f71ba tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:57.863257 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f1dc63bf-aa04-43d8-b124-4cad944f71ba tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:57.863591 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f1dc63bf-aa04-43d8-b124-4cad944f71ba tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:58.111369 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-f1dc63bf-aa04-43d8-b124-4cad944f71ba tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:55:58.120862 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-f1dc63bf-aa04-43d8-b124-4cad944f71ba tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906" status: 200 len: 1736 microversion: 2.1 time: 0.278056 Sep 20 04:55:58.137080 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 234/384] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:57 2022] GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906 => generated 1736 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:55:58.143146 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-7345b791-51d7-4ee0-b655-c46532902994 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-771413683", "imageRef": "080ea053-830e-4470-a886-0ab99b0ab3e0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "637b3136-e650-47ef-a9fe-492091eb8174"}], "security_groups": [{"name": "tempest-securitygroup--11119732"}], "key_name": "tempest-keypair-126007507", "user_data": "}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:55:58.271181 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.network.neutron [None req-7345b791-51d7-4ee0-b655-c46532902994 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] validate_networks() for [('637b3136-e650-47ef-a9fe-492091eb8174', None, None, None, None, None)] {{(pid=126813) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 20 04:55:58.917927 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-7345b791-51d7-4ee0-b655-c46532902994 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Flavor limits 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 20 04:55:58.919496 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-7345b791-51d7-4ee0-b655-c46532902994 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Image limits 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 20 04:55:58.920140 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-7345b791-51d7-4ee0-b655-c46532902994 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Flavor pref 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 20 04:55:58.921507 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-7345b791-51d7-4ee0-b655-c46532902994 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Image pref 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 20 04:55:58.922126 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-7345b791-51d7-4ee0-b655-c46532902994 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 20 04:55:58.949944 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7345b791-51d7-4ee0-b655-c46532902994 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:58.950699 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7345b791-51d7-4ee0-b655-c46532902994 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:58.951145 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7345b791-51d7-4ee0-b655-c46532902994 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:58.952695 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7345b791-51d7-4ee0-b655-c46532902994 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:58.954198 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7345b791-51d7-4ee0-b655-c46532902994 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:58.959252 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7345b791-51d7-4ee0-b655-c46532902994 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:58.999320 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-7345b791-51d7-4ee0-b655-c46532902994 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Getting quotas for project 4f0f0b8842ae496292c27a6ee1350d32. Resources: {'ram', 'cores', 'instances'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 04:55:59.008472 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-7345b791-51d7-4ee0-b655-c46532902994 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Getting quotas for user c93f22104a7b4a7caf0cc8b7180ffc55 and project 4f0f0b8842ae496292c27a6ee1350d32. Resources: {'ram', 'cores', 'instances'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 04:55:59.025761 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-7345b791-51d7-4ee0-b655-c46532902994 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Going to run 1 instances... {{(pid=126813) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 20 04:55:59.029663 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-7345b791-51d7-4ee0-b655-c46532902994 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 08dd20c3-27f2-4e1a-b083-c17cb2171a16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='080ea053-830e-4470-a886-0ab99b0ab3e0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126813) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 20 04:55:59.105797 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-7345b791-51d7-4ee0-b655-c46532902994 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.966395 Sep 20 04:55:59.107397 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 235/385] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Sep 20 04:55:58 2022] POST /compute/v2.1/servers => generated 400 bytes in 970 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 20 04:55:59.118674 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-a503fc1e-e66a-43af-ab88-5aa3d65aec64 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:59.118972 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-a503fc1e-e66a-43af-ab88-5aa3d65aec64 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] [instance: d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:59.167038 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a503fc1e-e66a-43af-ab88-5aa3d65aec64 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:59.167556 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a503fc1e-e66a-43af-ab88-5aa3d65aec64 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:59.167997 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a503fc1e-e66a-43af-ab88-5aa3d65aec64 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:59.169023 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a503fc1e-e66a-43af-ab88-5aa3d65aec64 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:59.169643 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a503fc1e-e66a-43af-ab88-5aa3d65aec64 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:59.170246 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a503fc1e-e66a-43af-ab88-5aa3d65aec64 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:59.434775 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-a503fc1e-e66a-43af-ab88-5aa3d65aec64 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d877f0c71f4e18854813780214ed6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725d386301d648de85fd6c4767250c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:55:59.444252 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-a503fc1e-e66a-43af-ab88-5aa3d65aec64 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] 10.222.0.27 "GET /compute/v2.1/servers/d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d" status: 200 len: 1319 microversion: 2.1 time: 0.335063 Sep 20 04:55:59.456761 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 236/386] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:59 2022] GET /compute/v2.1/servers/d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d => generated 1319 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:55:59.456761 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-69c33e29-44fb-497d-8327-5dae30c09f0e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:59.456761 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-69c33e29-44fb-497d-8327-5dae30c09f0e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 08dd20c3-27f2-4e1a-b083-c17cb2171a16] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:59.531652 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-69c33e29-44fb-497d-8327-5dae30c09f0e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:55:59.538814 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-69c33e29-44fb-497d-8327-5dae30c09f0e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16" status: 200 len: 1240 microversion: 2.1 time: 0.092320 Sep 20 04:55:59.540313 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 237/387] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:59 2022] GET /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16 => generated 1240 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:55:59.545719 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-4fafe998-166a-4cd2-b51e-ccf641f34c95 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:55:59.546364 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-4fafe998-166a-4cd2-b51e-ccf641f34c95 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:55:59.552474 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4fafe998-166a-4cd2-b51e-ccf641f34c95 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:59.553005 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4fafe998-166a-4cd2-b51e-ccf641f34c95 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:59.553447 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4fafe998-166a-4cd2-b51e-ccf641f34c95 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:59.554146 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4fafe998-166a-4cd2-b51e-ccf641f34c95 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:55:59.554601 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4fafe998-166a-4cd2-b51e-ccf641f34c95 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:55:59.555076 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4fafe998-166a-4cd2-b51e-ccf641f34c95 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:55:59.560450 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:55:59.710795 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-4fafe998-166a-4cd2-b51e-ccf641f34c95 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:55:59.721751 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-4fafe998-166a-4cd2-b51e-ccf641f34c95 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906" status: 200 len: 1736 microversion: 2.1 time: 0.179064 Sep 20 04:55:59.722662 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 238/388] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:55:59 2022] GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906 => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:56:00.074469 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-d32f1f9a-b7c2-4991-907b-635885d07b75 tempest-TestShelveInstance-175665765 tempest-TestShelveInstance-175665765-project] Calling method '.version_select at 0x7f2e4a6ef5e0>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:00.103648 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-d32f1f9a-b7c2-4991-907b-635885d07b75 tempest-TestShelveInstance-175665765 tempest-TestShelveInstance-175665765-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1643038489" status: 202 len: 0 microversion: 2.1 time: 0.033488 Sep 20 04:56:00.105215 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 239/389] 10.222.0.27 () {58 vars in 1254 bytes} [Tue Sep 20 04:56:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1643038489 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 20 04:56:00.471167 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-becc2b39-8403-4941-9ed9-5aebd8dfd886 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:00.471546 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-becc2b39-8403-4941-9ed9-5aebd8dfd886 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] [instance: d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:00.478421 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-becc2b39-8403-4941-9ed9-5aebd8dfd886 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:00.479310 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-becc2b39-8403-4941-9ed9-5aebd8dfd886 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:00.479955 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-becc2b39-8403-4941-9ed9-5aebd8dfd886 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:00.481137 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-becc2b39-8403-4941-9ed9-5aebd8dfd886 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:00.481817 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-becc2b39-8403-4941-9ed9-5aebd8dfd886 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:00.482476 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-becc2b39-8403-4941-9ed9-5aebd8dfd886 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:00.945640 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-becc2b39-8403-4941-9ed9-5aebd8dfd886 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d877f0c71f4e18854813780214ed6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725d386301d648de85fd6c4767250c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:00.957984 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-becc2b39-8403-4941-9ed9-5aebd8dfd886 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] 10.222.0.27 "GET /compute/v2.1/servers/d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d" status: 200 len: 1319 microversion: 2.1 time: 0.489537 Sep 20 04:56:00.959824 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 240/390] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:00 2022] GET /compute/v2.1/servers/d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d => generated 1319 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:56:00.972717 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-87e2273d-bd34-4934-90c0-c714ab87e29f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:00.973742 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-87e2273d-bd34-4934-90c0-c714ab87e29f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 08dd20c3-27f2-4e1a-b083-c17cb2171a16] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:00.988873 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-87e2273d-bd34-4934-90c0-c714ab87e29f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:00.989596 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-87e2273d-bd34-4934-90c0-c714ab87e29f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:00.990226 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-87e2273d-bd34-4934-90c0-c714ab87e29f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:00.991113 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-87e2273d-bd34-4934-90c0-c714ab87e29f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:00.992846 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-87e2273d-bd34-4934-90c0-c714ab87e29f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:00.995084 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-87e2273d-bd34-4934-90c0-c714ab87e29f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:01.099329 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-87e2273d-bd34-4934-90c0-c714ab87e29f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:01.110042 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-87e2273d-bd34-4934-90c0-c714ab87e29f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16" status: 200 len: 1298 microversion: 2.1 time: 0.148468 Sep 20 04:56:01.117684 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 241/391] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:00 2022] GET /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16 => generated 1298 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:56:01.123363 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-2aa1cdfc-4be2-41bc-92c1-a41380760047 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:01.134827 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-2aa1cdfc-4be2-41bc-92c1-a41380760047 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:01.149381 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2aa1cdfc-4be2-41bc-92c1-a41380760047 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:01.150158 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2aa1cdfc-4be2-41bc-92c1-a41380760047 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:01.150785 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2aa1cdfc-4be2-41bc-92c1-a41380760047 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:01.152492 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2aa1cdfc-4be2-41bc-92c1-a41380760047 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:01.153533 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2aa1cdfc-4be2-41bc-92c1-a41380760047 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:01.155248 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2aa1cdfc-4be2-41bc-92c1-a41380760047 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:01.516192 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-2aa1cdfc-4be2-41bc-92c1-a41380760047 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:01.526565 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-2aa1cdfc-4be2-41bc-92c1-a41380760047 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906" status: 200 len: 1736 microversion: 2.1 time: 0.407542 Sep 20 04:56:01.527606 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 242/392] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:01 2022] GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906 => generated 1736 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:56:01.773306 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-fe269a57-c844-44b2-bbc9-56b51acf47c7 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Action: 'create', calling method: .version_select at 0x7f2e4a71d9d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-140645421", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEzKCZii2vjqM3iqOGQvCcrCD+rj+l+iXP5n4mSGJ/4xJ6Wo6nZLqhdbwfPwaqpyBTZtz85/pqrhC9v6lkzXskKbk9sW8NFQEUHO0ghpJZ3Kaww3xfutyrywtrZxapSz4Q=="}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:56:01.801525 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-fe269a57-c844-44b2-bbc9-56b51acf47c7 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Getting quotas for project 46ddf925b345471da94d05998a6a0540. Resources: {'key_pairs'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 04:56:01.805660 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-fe269a57-c844-44b2-bbc9-56b51acf47c7 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Getting quotas for user 946a0fd33f754ce1aa534ab88dc95aa9 and project 46ddf925b345471da94d05998a6a0540. Resources: {'key_pairs'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 04:56:01.851685 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-fe269a57-c844-44b2-bbc9-56b51acf47c7 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.312597 Sep 20 04:56:01.853054 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 243/393] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Sep 20 04:56:01 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:56:01.858747 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-0ee11759-c972-472f-8691-91c40ed44232 req-375f7048-07fc-4d8e-9200-f420f79b9d55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d", "name": "network-vif-plugged", "status": "completed", "tag": "31e662db-2a8c-47a3-862e-c1f0f71c017f"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:56:01.870954 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-0ee11759-c972-472f-8691-91c40ed44232 req-375f7048-07fc-4d8e-9200-f420f79b9d55 service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:01.871458 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-0ee11759-c972-472f-8691-91c40ed44232 req-375f7048-07fc-4d8e-9200-f420f79b9d55 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:01.871893 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-0ee11759-c972-472f-8691-91c40ed44232 req-375f7048-07fc-4d8e-9200-f420f79b9d55 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:01.891759 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-0ee11759-c972-472f-8691-91c40ed44232 req-375f7048-07fc-4d8e-9200-f420f79b9d55 service nova] Creating event network-vif-plugged:31e662db-2a8c-47a3-862e-c1f0f71c017f for instance d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d on hv-cinder-75671 Sep 20 04:56:01.900203 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-0ee11759-c972-472f-8691-91c40ed44232 req-375f7048-07fc-4d8e-9200-f420f79b9d55 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045190 Sep 20 04:56:01.901520 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 244/394] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 04:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:56:01.987762 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-57f2d466-519f-4e13-afe9-cabc0793ac46 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:01.988908 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-57f2d466-519f-4e13-afe9-cabc0793ac46 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] [instance: d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:02.001566 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-57f2d466-519f-4e13-afe9-cabc0793ac46 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:02.002092 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-57f2d466-519f-4e13-afe9-cabc0793ac46 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:02.002539 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-57f2d466-519f-4e13-afe9-cabc0793ac46 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:02.003367 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-57f2d466-519f-4e13-afe9-cabc0793ac46 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:02.006847 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-57f2d466-519f-4e13-afe9-cabc0793ac46 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:02.008744 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-57f2d466-519f-4e13-afe9-cabc0793ac46 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:02.375959 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-57f2d466-519f-4e13-afe9-cabc0793ac46 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d877f0c71f4e18854813780214ed6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725d386301d648de85fd6c4767250c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:02.386019 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-57f2d466-519f-4e13-afe9-cabc0793ac46 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] 10.222.0.27 "GET /compute/v2.1/servers/d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d" status: 200 len: 1319 microversion: 2.1 time: 0.402877 Sep 20 04:56:02.387462 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 245/395] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:01 2022] GET /compute/v2.1/servers/d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d => generated 1319 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:56:02.394207 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-d996c37f-5b1c-4d4d-af69-11ee8463c3a6 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:02.395383 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-d996c37f-5b1c-4d4d-af69-11ee8463c3a6 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 08dd20c3-27f2-4e1a-b083-c17cb2171a16] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:02.406780 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d996c37f-5b1c-4d4d-af69-11ee8463c3a6 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:02.407712 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d996c37f-5b1c-4d4d-af69-11ee8463c3a6 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:02.408153 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d996c37f-5b1c-4d4d-af69-11ee8463c3a6 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:02.408873 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d996c37f-5b1c-4d4d-af69-11ee8463c3a6 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:02.409476 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d996c37f-5b1c-4d4d-af69-11ee8463c3a6 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:02.409896 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d996c37f-5b1c-4d4d-af69-11ee8463c3a6 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:02.772777 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-d996c37f-5b1c-4d4d-af69-11ee8463c3a6 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:02.789245 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-d996c37f-5b1c-4d4d-af69-11ee8463c3a6 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16" status: 200 len: 1364 microversion: 2.1 time: 0.400423 Sep 20 04:56:02.790265 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 246/396] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:02 2022] GET /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16 => generated 1364 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:56:02.810769 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-cdc18900-a179-449f-ae53-9d26c3005b9f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:02.812053 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-cdc18900-a179-449f-ae53-9d26c3005b9f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:02.830015 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:INSERT=5 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:56:02.833047 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-cdc18900-a179-449f-ae53-9d26c3005b9f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:02.833835 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-cdc18900-a179-449f-ae53-9d26c3005b9f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:02.834418 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-cdc18900-a179-449f-ae53-9d26c3005b9f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:02.836230 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-cdc18900-a179-449f-ae53-9d26c3005b9f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:02.836818 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-cdc18900-a179-449f-ae53-9d26c3005b9f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:02.837968 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-cdc18900-a179-449f-ae53-9d26c3005b9f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:03.276224 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-cdc18900-a179-449f-ae53-9d26c3005b9f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:03.287237 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-cdc18900-a179-449f-ae53-9d26c3005b9f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906" status: 200 len: 1736 microversion: 2.1 time: 0.495782 Sep 20 04:56:03.288052 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 247/397] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:02 2022] GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906 => generated 1736 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:56:03.412079 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-6e7e7ff1-7000-4833-9933-3d1cce83b8c5 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:03.414120 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-6e7e7ff1-7000-4833-9933-3d1cce83b8c5 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] [instance: d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:03.428065 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6e7e7ff1-7000-4833-9933-3d1cce83b8c5 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:03.431711 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6e7e7ff1-7000-4833-9933-3d1cce83b8c5 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:03.432173 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6e7e7ff1-7000-4833-9933-3d1cce83b8c5 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:03.436127 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6e7e7ff1-7000-4833-9933-3d1cce83b8c5 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:03.438328 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6e7e7ff1-7000-4833-9933-3d1cce83b8c5 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:03.439509 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6e7e7ff1-7000-4833-9933-3d1cce83b8c5 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:04.098689 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-6e7e7ff1-7000-4833-9933-3d1cce83b8c5 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d877f0c71f4e18854813780214ed6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725d386301d648de85fd6c4767250c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:04.110829 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-6e7e7ff1-7000-4833-9933-3d1cce83b8c5 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] 10.222.0.27 "GET /compute/v2.1/servers/d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d" status: 200 len: 1319 microversion: 2.1 time: 0.703182 Sep 20 04:56:04.125003 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 248/398] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:03 2022] GET /compute/v2.1/servers/d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d => generated 1319 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:56:04.131474 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-7a12b71e-8c01-4df6-92b4-4bb80ff380b7 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:04.132387 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-7a12b71e-8c01-4df6-92b4-4bb80ff380b7 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 08dd20c3-27f2-4e1a-b083-c17cb2171a16] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:04.139939 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7a12b71e-8c01-4df6-92b4-4bb80ff380b7 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:04.144895 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7a12b71e-8c01-4df6-92b4-4bb80ff380b7 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:04.145509 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7a12b71e-8c01-4df6-92b4-4bb80ff380b7 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:04.146381 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7a12b71e-8c01-4df6-92b4-4bb80ff380b7 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:04.158053 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7a12b71e-8c01-4df6-92b4-4bb80ff380b7 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:04.158730 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7a12b71e-8c01-4df6-92b4-4bb80ff380b7 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:04.370450 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-7a12b71e-8c01-4df6-92b4-4bb80ff380b7 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:04.378841 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-7a12b71e-8c01-4df6-92b4-4bb80ff380b7 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16" status: 200 len: 1364 microversion: 2.1 time: 0.252434 Sep 20 04:56:04.384311 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 249/399] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:04 2022] GET /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16 => generated 1364 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:56:04.398587 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-2a1c31ed-3d25-4062-b16e-8dfc9dd1fcaa tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:04.399466 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-2a1c31ed-3d25-4062-b16e-8dfc9dd1fcaa tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:04.415419 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2a1c31ed-3d25-4062-b16e-8dfc9dd1fcaa tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:04.416082 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2a1c31ed-3d25-4062-b16e-8dfc9dd1fcaa tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:04.416338 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2a1c31ed-3d25-4062-b16e-8dfc9dd1fcaa tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:04.417142 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2a1c31ed-3d25-4062-b16e-8dfc9dd1fcaa tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:04.417590 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2a1c31ed-3d25-4062-b16e-8dfc9dd1fcaa tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:04.418012 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2a1c31ed-3d25-4062-b16e-8dfc9dd1fcaa tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:04.647846 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-2a1c31ed-3d25-4062-b16e-8dfc9dd1fcaa tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:04.662464 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-2a1c31ed-3d25-4062-b16e-8dfc9dd1fcaa tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906" status: 200 len: 1736 microversion: 2.1 time: 0.276827 Sep 20 04:56:04.667458 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 250/400] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:04 2022] GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906 => generated 1736 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:56:04.676773 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-33df5849-6c94-479f-a963-b6d72190d077 req-abaa7b7b-3312-44ae-a740-f3113e885612 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08dd20c3-27f2-4e1a-b083-c17cb2171a16", "tag": "9dbcee22-d7bf-4a73-ad7d-7dfafedd14d0"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:56:04.702821 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-33df5849-6c94-479f-a963-b6d72190d077 req-abaa7b7b-3312-44ae-a740-f3113e885612 service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:04.708940 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-33df5849-6c94-479f-a963-b6d72190d077 req-abaa7b7b-3312-44ae-a740-f3113e885612 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:04.709950 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-33df5849-6c94-479f-a963-b6d72190d077 req-abaa7b7b-3312-44ae-a740-f3113e885612 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:04.745809 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-33df5849-6c94-479f-a963-b6d72190d077 req-abaa7b7b-3312-44ae-a740-f3113e885612 service nova] Creating event network-changed:9dbcee22-d7bf-4a73-ad7d-7dfafedd14d0 for instance 08dd20c3-27f2-4e1a-b083-c17cb2171a16 on hv-cinder-75671 Sep 20 04:56:04.764291 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-33df5849-6c94-479f-a963-b6d72190d077 req-abaa7b7b-3312-44ae-a740-f3113e885612 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094866 Sep 20 04:56:04.765458 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 251/401] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 04:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:56:05.141741 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-aae79c26-940f-4251-aecd-b5013af6b32d tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:05.142624 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-aae79c26-940f-4251-aecd-b5013af6b32d tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] [instance: d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:05.149175 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-aae79c26-940f-4251-aecd-b5013af6b32d tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:05.149664 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-aae79c26-940f-4251-aecd-b5013af6b32d tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:05.150101 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-aae79c26-940f-4251-aecd-b5013af6b32d tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:05.150807 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-aae79c26-940f-4251-aecd-b5013af6b32d tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:05.151258 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-aae79c26-940f-4251-aecd-b5013af6b32d tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:05.151686 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-aae79c26-940f-4251-aecd-b5013af6b32d tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:05.341212 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-aae79c26-940f-4251-aecd-b5013af6b32d tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d877f0c71f4e18854813780214ed6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725d386301d648de85fd6c4767250c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:05.349700 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-aae79c26-940f-4251-aecd-b5013af6b32d tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] 10.222.0.27 "GET /compute/v2.1/servers/d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d" status: 200 len: 1507 microversion: 2.1 time: 0.212926 Sep 20 04:56:05.354912 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 252/402] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:05 2022] GET /compute/v2.1/servers/d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d => generated 1507 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:56:05.387882 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-9b95799d-e108-4084-a7ef-620ad7e26d2b tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03806730-86c6-4435-921b-cb5de0a89237", "device": "/dev/sdb"}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:56:05.390776 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-9b95799d-e108-4084-a7ef-620ad7e26d2b tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] [instance: d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:05.397919 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9b95799d-e108-4084-a7ef-620ad7e26d2b tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:05.398456 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9b95799d-e108-4084-a7ef-620ad7e26d2b tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:05.398893 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9b95799d-e108-4084-a7ef-620ad7e26d2b tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:05.399596 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9b95799d-e108-4084-a7ef-620ad7e26d2b tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:05.400052 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9b95799d-e108-4084-a7ef-620ad7e26d2b tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:05.400479 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9b95799d-e108-4084-a7ef-620ad7e26d2b tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:06.449545 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-9b95799d-e108-4084-a7ef-620ad7e26d2b tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] 10.222.0.27 "POST /compute/v2.1/servers/d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.073485 Sep 20 04:56:06.456493 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 253/403] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Sep 20 04:56:05 2022] POST /compute/v2.1/servers/d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d/os-volume_attachments => generated 194 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:56:06.464525 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-e10a3e20-3ad0-44d0-ab3b-0e97ff2808f4 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:06.466099 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-e10a3e20-3ad0-44d0-ab3b-0e97ff2808f4 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 08dd20c3-27f2-4e1a-b083-c17cb2171a16] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:06.477907 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e10a3e20-3ad0-44d0-ab3b-0e97ff2808f4 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:06.480236 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e10a3e20-3ad0-44d0-ab3b-0e97ff2808f4 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:06.480940 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e10a3e20-3ad0-44d0-ab3b-0e97ff2808f4 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:06.482430 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e10a3e20-3ad0-44d0-ab3b-0e97ff2808f4 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:06.483144 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e10a3e20-3ad0-44d0-ab3b-0e97ff2808f4 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:06.483975 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e10a3e20-3ad0-44d0-ab3b-0e97ff2808f4 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:06.783179 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-e10a3e20-3ad0-44d0-ab3b-0e97ff2808f4 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:06.806042 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-e10a3e20-3ad0-44d0-ab3b-0e97ff2808f4 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16" status: 200 len: 1364 microversion: 2.1 time: 0.347567 Sep 20 04:56:06.821810 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 254/404] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:06 2022] GET /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16 => generated 1364 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:56:06.830724 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-e0b535e8-45a0-41f6-ba60-5c36c25d31c2 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:06.831868 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-e0b535e8-45a0-41f6-ba60-5c36c25d31c2 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:06.840166 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e0b535e8-45a0-41f6-ba60-5c36c25d31c2 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:06.840958 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e0b535e8-45a0-41f6-ba60-5c36c25d31c2 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:06.841630 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e0b535e8-45a0-41f6-ba60-5c36c25d31c2 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:06.842641 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e0b535e8-45a0-41f6-ba60-5c36c25d31c2 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:06.843311 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e0b535e8-45a0-41f6-ba60-5c36c25d31c2 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:06.844462 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e0b535e8-45a0-41f6-ba60-5c36c25d31c2 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:07.054664 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-e0b535e8-45a0-41f6-ba60-5c36c25d31c2 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:07.065408 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-e0b535e8-45a0-41f6-ba60-5c36c25d31c2 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906" status: 200 len: 1736 microversion: 2.1 time: 0.241959 Sep 20 04:56:07.065983 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 255/405] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:06 2022] GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906 => generated 1736 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:56:07.833016 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-55c07578-218b-420e-a109-b6d500b01b69 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:07.834342 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-55c07578-218b-420e-a109-b6d500b01b69 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 08dd20c3-27f2-4e1a-b083-c17cb2171a16] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:07.841995 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-55c07578-218b-420e-a109-b6d500b01b69 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:07.842769 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-55c07578-218b-420e-a109-b6d500b01b69 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:07.843118 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-55c07578-218b-420e-a109-b6d500b01b69 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:07.843842 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-55c07578-218b-420e-a109-b6d500b01b69 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:07.846015 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-55c07578-218b-420e-a109-b6d500b01b69 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:07.846458 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-55c07578-218b-420e-a109-b6d500b01b69 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:08.089690 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-55c07578-218b-420e-a109-b6d500b01b69 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:08.093982 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:56:08.100362 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-55c07578-218b-420e-a109-b6d500b01b69 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16" status: 200 len: 1364 microversion: 2.1 time: 0.270790 Sep 20 04:56:08.125660 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 256/406] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:07 2022] GET /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16 => generated 1364 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:56:08.136455 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-d1bbb0c8-b073-47e8-a194-9c9e4d7b48a3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:08.137324 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-d1bbb0c8-b073-47e8-a194-9c9e4d7b48a3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:08.147731 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d1bbb0c8-b073-47e8-a194-9c9e4d7b48a3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:08.148435 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d1bbb0c8-b073-47e8-a194-9c9e4d7b48a3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:08.149166 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d1bbb0c8-b073-47e8-a194-9c9e4d7b48a3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:08.166063 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d1bbb0c8-b073-47e8-a194-9c9e4d7b48a3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:08.166574 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d1bbb0c8-b073-47e8-a194-9c9e4d7b48a3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:08.167237 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d1bbb0c8-b073-47e8-a194-9c9e4d7b48a3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:08.365606 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-d1bbb0c8-b073-47e8-a194-9c9e4d7b48a3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:08.375234 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-d1bbb0c8-b073-47e8-a194-9c9e4d7b48a3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906" status: 200 len: 1736 microversion: 2.1 time: 0.248077 Sep 20 04:56:08.375831 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 257/407] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:08 2022] GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906 => generated 1736 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:56:09.138599 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-ed2bf86e-3960-430b-b665-3ea44906d9ec tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:09.139866 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-ed2bf86e-3960-430b-b665-3ea44906d9ec tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 08dd20c3-27f2-4e1a-b083-c17cb2171a16] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:09.143730 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell0:SELECT=4 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:56:09.147923 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ed2bf86e-3960-430b-b665-3ea44906d9ec tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:09.148410 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ed2bf86e-3960-430b-b665-3ea44906d9ec tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:09.148864 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ed2bf86e-3960-430b-b665-3ea44906d9ec tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:09.149555 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ed2bf86e-3960-430b-b665-3ea44906d9ec tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:09.150000 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ed2bf86e-3960-430b-b665-3ea44906d9ec tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:09.150454 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ed2bf86e-3960-430b-b665-3ea44906d9ec tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:09.347342 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-ed2bf86e-3960-430b-b665-3ea44906d9ec tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:09.376306 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-ed2bf86e-3960-430b-b665-3ea44906d9ec tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16" status: 200 len: 1364 microversion: 2.1 time: 0.241944 Sep 20 04:56:09.377867 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 258/408] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:09 2022] GET /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16 => generated 1364 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:56:09.396075 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-9eda298a-7c01-4b0a-bcab-d8c64019134b req-51db9020-71ac-47f6-a744-11bf5f21fa2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08dd20c3-27f2-4e1a-b083-c17cb2171a16", "name": "network-vif-plugged", "status": "completed", "tag": "9dbcee22-d7bf-4a73-ad7d-7dfafedd14d0"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:56:09.418749 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-9eda298a-7c01-4b0a-bcab-d8c64019134b req-51db9020-71ac-47f6-a744-11bf5f21fa2d service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:09.419246 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-9eda298a-7c01-4b0a-bcab-d8c64019134b req-51db9020-71ac-47f6-a744-11bf5f21fa2d service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:09.419679 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-9eda298a-7c01-4b0a-bcab-d8c64019134b req-51db9020-71ac-47f6-a744-11bf5f21fa2d service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:09.432287 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-9eda298a-7c01-4b0a-bcab-d8c64019134b req-51db9020-71ac-47f6-a744-11bf5f21fa2d service nova] Creating event network-vif-plugged:9dbcee22-d7bf-4a73-ad7d-7dfafedd14d0 for instance 08dd20c3-27f2-4e1a-b083-c17cb2171a16 on hv-cinder-75671 Sep 20 04:56:09.438308 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-9eda298a-7c01-4b0a-bcab-d8c64019134b req-51db9020-71ac-47f6-a744-11bf5f21fa2d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051636 Sep 20 04:56:09.439110 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 259/409] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 04:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:56:09.452913 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-86dae245-8f05-4a0f-a53a-6ac4551c8c03 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:09.453619 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-86dae245-8f05-4a0f-a53a-6ac4551c8c03 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:09.460150 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-86dae245-8f05-4a0f-a53a-6ac4551c8c03 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:09.460655 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-86dae245-8f05-4a0f-a53a-6ac4551c8c03 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:09.461093 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-86dae245-8f05-4a0f-a53a-6ac4551c8c03 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:09.464081 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-86dae245-8f05-4a0f-a53a-6ac4551c8c03 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:09.464567 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-86dae245-8f05-4a0f-a53a-6ac4551c8c03 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:09.466115 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-86dae245-8f05-4a0f-a53a-6ac4551c8c03 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:09.668991 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-86dae245-8f05-4a0f-a53a-6ac4551c8c03 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:09.678761 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-86dae245-8f05-4a0f-a53a-6ac4551c8c03 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906" status: 200 len: 1736 microversion: 2.1 time: 0.238287 Sep 20 04:56:09.679341 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 260/410] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:09 2022] GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906 => generated 1736 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:56:10.402094 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-fa1372db-6015-4abf-b92b-c5b1b5450606 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:10.402801 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-fa1372db-6015-4abf-b92b-c5b1b5450606 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 08dd20c3-27f2-4e1a-b083-c17cb2171a16] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:10.409435 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fa1372db-6015-4abf-b92b-c5b1b5450606 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:10.409979 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fa1372db-6015-4abf-b92b-c5b1b5450606 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:10.410480 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fa1372db-6015-4abf-b92b-c5b1b5450606 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:10.411262 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fa1372db-6015-4abf-b92b-c5b1b5450606 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:10.411775 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fa1372db-6015-4abf-b92b-c5b1b5450606 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:10.412260 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fa1372db-6015-4abf-b92b-c5b1b5450606 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:10.587131 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-fa1372db-6015-4abf-b92b-c5b1b5450606 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:10.595386 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-fa1372db-6015-4abf-b92b-c5b1b5450606 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16" status: 200 len: 1364 microversion: 2.1 time: 0.197224 Sep 20 04:56:10.596595 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 261/411] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:10 2022] GET /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16 => generated 1364 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:56:10.703540 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-54324e3e-970b-41eb-b7a2-bc60078b8361 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:10.704096 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-54324e3e-970b-41eb-b7a2-bc60078b8361 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:10.710029 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-54324e3e-970b-41eb-b7a2-bc60078b8361 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:10.710519 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-54324e3e-970b-41eb-b7a2-bc60078b8361 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:10.710957 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-54324e3e-970b-41eb-b7a2-bc60078b8361 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:10.711772 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-54324e3e-970b-41eb-b7a2-bc60078b8361 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:10.712233 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-54324e3e-970b-41eb-b7a2-bc60078b8361 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:10.712684 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-54324e3e-970b-41eb-b7a2-bc60078b8361 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:10.866451 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-54324e3e-970b-41eb-b7a2-bc60078b8361 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:10.875382 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-54324e3e-970b-41eb-b7a2-bc60078b8361 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906" status: 200 len: 1736 microversion: 2.1 time: 0.176931 Sep 20 04:56:10.876028 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 262/412] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:10 2022] GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906 => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:56:11.620196 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-b3c0fbb8-d644-4a12-bf36-2eb7cc04617c tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:11.621353 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-b3c0fbb8-d644-4a12-bf36-2eb7cc04617c tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 08dd20c3-27f2-4e1a-b083-c17cb2171a16] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:11.629099 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b3c0fbb8-d644-4a12-bf36-2eb7cc04617c tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:11.629552 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b3c0fbb8-d644-4a12-bf36-2eb7cc04617c tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:11.629984 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b3c0fbb8-d644-4a12-bf36-2eb7cc04617c tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:11.630951 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b3c0fbb8-d644-4a12-bf36-2eb7cc04617c tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:11.631528 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b3c0fbb8-d644-4a12-bf36-2eb7cc04617c tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:11.631952 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b3c0fbb8-d644-4a12-bf36-2eb7cc04617c tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:11.766988 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-b3c0fbb8-d644-4a12-bf36-2eb7cc04617c tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:11.776885 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-b3c0fbb8-d644-4a12-bf36-2eb7cc04617c tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16" status: 200 len: 1364 microversion: 2.1 time: 0.161162 Sep 20 04:56:11.777473 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 263/413] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:11 2022] GET /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:56:11.898502 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-0f7b0ea1-d649-4516-99a9-12b0b4e85c09 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:11.899162 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-0f7b0ea1-d649-4516-99a9-12b0b4e85c09 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:11.902657 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell0:SELECT=24 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:56:11.908220 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0f7b0ea1-d649-4516-99a9-12b0b4e85c09 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:11.908741 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0f7b0ea1-d649-4516-99a9-12b0b4e85c09 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:11.909179 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0f7b0ea1-d649-4516-99a9-12b0b4e85c09 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:11.909888 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0f7b0ea1-d649-4516-99a9-12b0b4e85c09 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:11.910346 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0f7b0ea1-d649-4516-99a9-12b0b4e85c09 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:11.910778 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0f7b0ea1-d649-4516-99a9-12b0b4e85c09 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:12.042535 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-0f7b0ea1-d649-4516-99a9-12b0b4e85c09 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:12.051002 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-0f7b0ea1-d649-4516-99a9-12b0b4e85c09 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906" status: 200 len: 1736 microversion: 2.1 time: 0.156415 Sep 20 04:56:12.051566 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 264/414] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:11 2022] GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:56:12.800905 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-c5020401-8ab8-4d6a-9181-b41ab92681a0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:12.801589 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-c5020401-8ab8-4d6a-9181-b41ab92681a0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 08dd20c3-27f2-4e1a-b083-c17cb2171a16] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:12.807967 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c5020401-8ab8-4d6a-9181-b41ab92681a0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:12.808447 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c5020401-8ab8-4d6a-9181-b41ab92681a0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:12.808916 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c5020401-8ab8-4d6a-9181-b41ab92681a0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:12.809598 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c5020401-8ab8-4d6a-9181-b41ab92681a0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:12.810048 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c5020401-8ab8-4d6a-9181-b41ab92681a0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:12.811014 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c5020401-8ab8-4d6a-9181-b41ab92681a0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:12.948144 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-c5020401-8ab8-4d6a-9181-b41ab92681a0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:12.959319 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-c5020401-8ab8-4d6a-9181-b41ab92681a0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16" status: 200 len: 1555 microversion: 2.1 time: 0.162262 Sep 20 04:56:12.959909 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 265/415] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:12 2022] GET /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16 => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:56:12.981920 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-9743dc69-7d07-4032-8e0d-d777c8e28066 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:12.982510 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-9743dc69-7d07-4032-8e0d-d777c8e28066 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 08dd20c3-27f2-4e1a-b083-c17cb2171a16] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:12.988815 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9743dc69-7d07-4032-8e0d-d777c8e28066 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:12.989303 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9743dc69-7d07-4032-8e0d-d777c8e28066 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:12.989739 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9743dc69-7d07-4032-8e0d-d777c8e28066 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:12.990450 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9743dc69-7d07-4032-8e0d-d777c8e28066 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:12.990907 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9743dc69-7d07-4032-8e0d-d777c8e28066 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:12.991364 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9743dc69-7d07-4032-8e0d-d777c8e28066 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:13.068123 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-9743dc69-7d07-4032-8e0d-d777c8e28066 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090001 Sep 20 04:56:13.068764 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 266/416] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Sep 20 04:56:12 2022] GET /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 04:56:13.074143 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-e3d84cd5-f4fb-4d5a-85a9-101ccc5bd28d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:13.074748 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-e3d84cd5-f4fb-4d5a-85a9-101ccc5bd28d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:13.081326 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e3d84cd5-f4fb-4d5a-85a9-101ccc5bd28d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:13.081809 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e3d84cd5-f4fb-4d5a-85a9-101ccc5bd28d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:13.082252 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e3d84cd5-f4fb-4d5a-85a9-101ccc5bd28d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:13.082933 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e3d84cd5-f4fb-4d5a-85a9-101ccc5bd28d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:13.083396 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e3d84cd5-f4fb-4d5a-85a9-101ccc5bd28d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:13.083802 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e3d84cd5-f4fb-4d5a-85a9-101ccc5bd28d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:13.596725 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-e3d84cd5-f4fb-4d5a-85a9-101ccc5bd28d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:13.604919 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-e3d84cd5-f4fb-4d5a-85a9-101ccc5bd28d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906" status: 200 len: 1736 microversion: 2.1 time: 0.534344 Sep 20 04:56:13.605477 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 267/417] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:13 2022] GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906 => generated 1736 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:56:14.362459 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-7b77856e-e7ee-4c0a-9f87-a496b014aa3b req-23f68592-79c9-4f7e-8adf-39ff70ffb574 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08dd20c3-27f2-4e1a-b083-c17cb2171a16", "tag": "9dbcee22-d7bf-4a73-ad7d-7dfafedd14d0"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:56:14.375293 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-7b77856e-e7ee-4c0a-9f87-a496b014aa3b req-23f68592-79c9-4f7e-8adf-39ff70ffb574 service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:14.376082 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-7b77856e-e7ee-4c0a-9f87-a496b014aa3b req-23f68592-79c9-4f7e-8adf-39ff70ffb574 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:14.376634 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-7b77856e-e7ee-4c0a-9f87-a496b014aa3b req-23f68592-79c9-4f7e-8adf-39ff70ffb574 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:14.390043 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-7b77856e-e7ee-4c0a-9f87-a496b014aa3b req-23f68592-79c9-4f7e-8adf-39ff70ffb574 service nova] Creating event network-changed:9dbcee22-d7bf-4a73-ad7d-7dfafedd14d0 for instance 08dd20c3-27f2-4e1a-b083-c17cb2171a16 on hv-cinder-75671 Sep 20 04:56:14.395067 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-7b77856e-e7ee-4c0a-9f87-a496b014aa3b req-23f68592-79c9-4f7e-8adf-39ff70ffb574 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037301 Sep 20 04:56:14.395860 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 268/418] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 04:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 04:56:14.631746 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-32362bc0-de05-431b-b060-7d4407f252c4 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:14.632498 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-32362bc0-de05-431b-b060-7d4407f252c4 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:14.639733 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-32362bc0-de05-431b-b060-7d4407f252c4 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:14.640215 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-32362bc0-de05-431b-b060-7d4407f252c4 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:14.640673 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-32362bc0-de05-431b-b060-7d4407f252c4 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:14.641358 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-32362bc0-de05-431b-b060-7d4407f252c4 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:14.641806 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-32362bc0-de05-431b-b060-7d4407f252c4 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:14.642480 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-32362bc0-de05-431b-b060-7d4407f252c4 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:14.773748 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-32362bc0-de05-431b-b060-7d4407f252c4 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:14.782681 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-32362bc0-de05-431b-b060-7d4407f252c4 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906" status: 200 len: 1736 microversion: 2.1 time: 0.155306 Sep 20 04:56:14.783259 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 269/419] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:14 2022] GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:56:15.806485 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-63efc280-2468-4bec-b1c8-ce1c1a0fd83b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:15.807119 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-63efc280-2468-4bec-b1c8-ce1c1a0fd83b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:15.813728 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-63efc280-2468-4bec-b1c8-ce1c1a0fd83b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:15.814215 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-63efc280-2468-4bec-b1c8-ce1c1a0fd83b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:15.814682 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-63efc280-2468-4bec-b1c8-ce1c1a0fd83b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:15.815531 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-63efc280-2468-4bec-b1c8-ce1c1a0fd83b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:15.816078 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-63efc280-2468-4bec-b1c8-ce1c1a0fd83b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:15.816616 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-63efc280-2468-4bec-b1c8-ce1c1a0fd83b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:15.943017 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-63efc280-2468-4bec-b1c8-ce1c1a0fd83b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:15.951184 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-63efc280-2468-4bec-b1c8-ce1c1a0fd83b tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906" status: 200 len: 1736 microversion: 2.1 time: 0.148568 Sep 20 04:56:15.951776 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 270/420] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:15 2022] GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:56:16.976894 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-a2bee205-92ad-49b0-8f29-bdaa2dd76c37 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:16.977602 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-a2bee205-92ad-49b0-8f29-bdaa2dd76c37 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:16.985616 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a2bee205-92ad-49b0-8f29-bdaa2dd76c37 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:16.986103 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a2bee205-92ad-49b0-8f29-bdaa2dd76c37 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:16.986541 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a2bee205-92ad-49b0-8f29-bdaa2dd76c37 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:16.988527 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a2bee205-92ad-49b0-8f29-bdaa2dd76c37 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:16.989013 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a2bee205-92ad-49b0-8f29-bdaa2dd76c37 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:16.989440 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a2bee205-92ad-49b0-8f29-bdaa2dd76c37 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:17.121872 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-a2bee205-92ad-49b0-8f29-bdaa2dd76c37 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:17.130104 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-a2bee205-92ad-49b0-8f29-bdaa2dd76c37 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906" status: 200 len: 1736 microversion: 2.1 time: 0.158933 Sep 20 04:56:17.130678 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 271/421] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:16 2022] GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:56:18.153832 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-dc19a646-4a62-4a06-bc94-d55ab3f65650 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:18.154510 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-dc19a646-4a62-4a06-bc94-d55ab3f65650 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:18.160868 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-dc19a646-4a62-4a06-bc94-d55ab3f65650 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:18.161355 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-dc19a646-4a62-4a06-bc94-d55ab3f65650 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:18.161792 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-dc19a646-4a62-4a06-bc94-d55ab3f65650 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:18.162477 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-dc19a646-4a62-4a06-bc94-d55ab3f65650 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:18.162920 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-dc19a646-4a62-4a06-bc94-d55ab3f65650 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:18.163338 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-dc19a646-4a62-4a06-bc94-d55ab3f65650 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:18.289896 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-dc19a646-4a62-4a06-bc94-d55ab3f65650 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:18.298099 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-dc19a646-4a62-4a06-bc94-d55ab3f65650 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906" status: 200 len: 1736 microversion: 2.1 time: 0.148327 Sep 20 04:56:18.298656 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 272/422] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:18 2022] GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:56:19.321453 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-fc6e27c2-1ddc-48d3-a663-8018a9fe21ec tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:19.322080 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-fc6e27c2-1ddc-48d3-a663-8018a9fe21ec tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:19.329284 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fc6e27c2-1ddc-48d3-a663-8018a9fe21ec tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:19.329765 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fc6e27c2-1ddc-48d3-a663-8018a9fe21ec tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:19.330204 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fc6e27c2-1ddc-48d3-a663-8018a9fe21ec tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:19.330889 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fc6e27c2-1ddc-48d3-a663-8018a9fe21ec tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:19.331342 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fc6e27c2-1ddc-48d3-a663-8018a9fe21ec tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:19.331768 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fc6e27c2-1ddc-48d3-a663-8018a9fe21ec tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:19.458882 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-fc6e27c2-1ddc-48d3-a663-8018a9fe21ec tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:19.467718 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-fc6e27c2-1ddc-48d3-a663-8018a9fe21ec tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906" status: 200 len: 1736 microversion: 2.1 time: 0.150275 Sep 20 04:56:19.468282 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 273/423] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:19 2022] GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:56:20.491071 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-020e6d0f-0070-41cb-a07a-ff6b1a2b6c94 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:20.491701 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-020e6d0f-0070-41cb-a07a-ff6b1a2b6c94 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:20.498661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-020e6d0f-0070-41cb-a07a-ff6b1a2b6c94 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:20.499342 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-020e6d0f-0070-41cb-a07a-ff6b1a2b6c94 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:20.499832 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-020e6d0f-0070-41cb-a07a-ff6b1a2b6c94 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:20.500477 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-020e6d0f-0070-41cb-a07a-ff6b1a2b6c94 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:20.500994 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-020e6d0f-0070-41cb-a07a-ff6b1a2b6c94 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:20.501414 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-020e6d0f-0070-41cb-a07a-ff6b1a2b6c94 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:20.635244 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-020e6d0f-0070-41cb-a07a-ff6b1a2b6c94 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:20.644034 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-020e6d0f-0070-41cb-a07a-ff6b1a2b6c94 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906" status: 200 len: 1736 microversion: 2.1 time: 0.156777 Sep 20 04:56:20.644624 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 274/424] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:20 2022] GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:56:21.667499 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-555c1f35-286d-48cf-8632-3182b85b0b56 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:21.668113 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-555c1f35-286d-48cf-8632-3182b85b0b56 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:21.675085 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-555c1f35-286d-48cf-8632-3182b85b0b56 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:21.675597 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-555c1f35-286d-48cf-8632-3182b85b0b56 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:21.676032 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-555c1f35-286d-48cf-8632-3182b85b0b56 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:21.676748 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-555c1f35-286d-48cf-8632-3182b85b0b56 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:21.677203 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-555c1f35-286d-48cf-8632-3182b85b0b56 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:21.677625 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-555c1f35-286d-48cf-8632-3182b85b0b56 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:21.681737 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell1:SELECT=100 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:56:21.802649 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-555c1f35-286d-48cf-8632-3182b85b0b56 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:21.810794 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-555c1f35-286d-48cf-8632-3182b85b0b56 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906" status: 200 len: 1736 microversion: 2.1 time: 0.147176 Sep 20 04:56:21.811350 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 275/425] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:21 2022] GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:56:22.834485 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-fd67db3b-c548-4745-92df-56f082f04b04 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:22.835182 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-fd67db3b-c548-4745-92df-56f082f04b04 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:22.841801 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fd67db3b-c548-4745-92df-56f082f04b04 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:22.842396 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fd67db3b-c548-4745-92df-56f082f04b04 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:22.842776 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fd67db3b-c548-4745-92df-56f082f04b04 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:22.843502 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fd67db3b-c548-4745-92df-56f082f04b04 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:22.843955 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fd67db3b-c548-4745-92df-56f082f04b04 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:22.844450 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fd67db3b-c548-4745-92df-56f082f04b04 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:22.977858 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-fd67db3b-c548-4745-92df-56f082f04b04 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:22.986619 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-fd67db3b-c548-4745-92df-56f082f04b04 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906" status: 200 len: 1736 microversion: 2.1 time: 0.156108 Sep 20 04:56:22.987485 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 276/426] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:22 2022] GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:56:24.010137 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-b8f971c2-b9cd-4525-9c8d-6c0d15994aab tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:24.010791 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-b8f971c2-b9cd-4525-9c8d-6c0d15994aab tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:24.019883 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b8f971c2-b9cd-4525-9c8d-6c0d15994aab tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:24.020370 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b8f971c2-b9cd-4525-9c8d-6c0d15994aab tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:24.020940 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b8f971c2-b9cd-4525-9c8d-6c0d15994aab tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:24.021694 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b8f971c2-b9cd-4525-9c8d-6c0d15994aab tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:24.022148 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b8f971c2-b9cd-4525-9c8d-6c0d15994aab tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:24.023115 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b8f971c2-b9cd-4525-9c8d-6c0d15994aab tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:24.166699 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-b8f971c2-b9cd-4525-9c8d-6c0d15994aab tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:24.176313 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-b8f971c2-b9cd-4525-9c8d-6c0d15994aab tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906" status: 200 len: 1716 microversion: 2.1 time: 0.169961 Sep 20 04:56:24.177056 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 277/427] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:24 2022] GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906 => generated 1716 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:56:24.284547 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-6a9c8185-8616-4fee-a84b-79cead3b11fe tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-902833639", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-140645421", "security_groups": [{"name": "tempest-secgroup-smoke-293602655"}], "block_device_mapping_v2": [{"uuid": "7a0209e5-6307-4a9a-8c00-43279c69b9c2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6de81d04-87bb-4e82-ba15-9636966f9274"}]}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:56:24.396634 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.network.neutron [None req-6a9c8185-8616-4fee-a84b-79cead3b11fe tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] validate_networks() for [('6de81d04-87bb-4e82-ba15-9636966f9274', None, None, None, None, None)] {{(pid=126813) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 20 04:56:24.759659 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-6a9c8185-8616-4fee-a84b-79cead3b11fe tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Flavor limits 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 20 04:56:24.760081 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-6a9c8185-8616-4fee-a84b-79cead3b11fe tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Image limits 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 20 04:56:24.760546 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-6a9c8185-8616-4fee-a84b-79cead3b11fe tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Flavor pref 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 20 04:56:24.760978 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-6a9c8185-8616-4fee-a84b-79cead3b11fe tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Image pref 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 20 04:56:24.761383 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-6a9c8185-8616-4fee-a84b-79cead3b11fe tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 20 04:56:24.770397 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6a9c8185-8616-4fee-a84b-79cead3b11fe tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:24.770868 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6a9c8185-8616-4fee-a84b-79cead3b11fe tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:24.771298 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6a9c8185-8616-4fee-a84b-79cead3b11fe tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:24.772009 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6a9c8185-8616-4fee-a84b-79cead3b11fe tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:24.772455 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6a9c8185-8616-4fee-a84b-79cead3b11fe tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:24.772908 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6a9c8185-8616-4fee-a84b-79cead3b11fe tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:24.789521 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-6a9c8185-8616-4fee-a84b-79cead3b11fe tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Getting quotas for project 46ddf925b345471da94d05998a6a0540. Resources: {'ram', 'cores', 'instances'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 04:56:24.793505 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-6a9c8185-8616-4fee-a84b-79cead3b11fe tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Getting quotas for user 946a0fd33f754ce1aa534ab88dc95aa9 and project 46ddf925b345471da94d05998a6a0540. Resources: {'ram', 'cores', 'instances'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 04:56:24.854076 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-6a9c8185-8616-4fee-a84b-79cead3b11fe tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Going to run 1 instances... {{(pid=126813) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 20 04:56:24.856224 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-6a9c8185-8616-4fee-a84b-79cead3b11fe tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: 417f5e13-88b2-4fc7-b79a-fe70372ed20d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7a0209e5-6307-4a9a-8c00-43279c69b9c2',volume_size=None,volume_type=None)] {{(pid=126813) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 20 04:56:24.986181 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-6a9c8185-8616-4fee-a84b-79cead3b11fe tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.705404 Sep 20 04:56:24.986998 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 278/428] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Sep 20 04:56:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 20 04:56:24.991554 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-b43f08bf-668a-4bf0-9b20-fb9411db7a0c tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:24.992055 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-b43f08bf-668a-4bf0-9b20-fb9411db7a0c tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:24.998330 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b43f08bf-668a-4bf0-9b20-fb9411db7a0c tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:24.998810 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b43f08bf-668a-4bf0-9b20-fb9411db7a0c tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:24.999248 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b43f08bf-668a-4bf0-9b20-fb9411db7a0c tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:24.999936 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b43f08bf-668a-4bf0-9b20-fb9411db7a0c tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:25.000387 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b43f08bf-668a-4bf0-9b20-fb9411db7a0c tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:25.000848 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b43f08bf-668a-4bf0-9b20-fb9411db7a0c tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:25.087983 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.wsgi [None req-b43f08bf-668a-4bf0-9b20-fb9411db7a0c tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] HTTP exception thrown: Cannot 'detach_volume' instance 8df00208-8207-4ff8-9979-2e00926de906 while it is in vm_state rescued Sep 20 04:56:25.089729 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-b43f08bf-668a-4bf0-9b20-fb9411db7a0c tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Request method failure captured: Sep 20 04:56:25.089729 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: request: DELETE /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906/os-volume_attachments/f6b33c1f-e645-4e15-9aec-ec8a988a485d HTTP/1.1 Sep 20 04:56:25.089729 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept: application/json Sep 20 04:56:25.089729 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept-Encoding: identity Sep 20 04:56:25.089729 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Connection: close Sep 20 04:56:25.089729 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Length: 0 Sep 20 04:56:25.089729 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Type: application/json Sep 20 04:56:25.089729 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Host: 10.222.0.27 Sep 20 04:56:25.089729 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Openstack-System-Scope: None Sep 20 04:56:25.089729 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: User-Agent: python-urllib3/1.26.12 Sep 20 04:56:25.089729 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Auth-Token: gAAAAABjKUbuqmu710n-3SCVM36yM7K-f797gToLzqjsDE8VJysUBrvG5j-mQzogHDlEQu9N838xq1zWP21_6m2gF-Ihax1sPUYdHwZXOTHQerCv9C5MDRbeGOwZhkLdVG9uye1-Ii1JZSsdS5iGMvHtRw8Q9ofnz0LEtfTZ8xxH8stYtJrOnkg Sep 20 04:56:25.089729 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Id: None Sep 20 04:56:25.089729 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Name: None Sep 20 04:56:25.089729 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Identity-Status: Confirmed Sep 20 04:56:25.089729 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Is-Admin-Project: True Sep 20 04:56:25.089729 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Id: default Sep 20 04:56:25.089729 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Name: Default Sep 20 04:56:25.089729 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Id: 5f0a24f6f6994f45bd314d3009b0a572 Sep 20 04:56:25.089729 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-447939399 Sep 20 04:56:25.089729 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Role: reader,member Sep 20 04:56:25.089729 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Roles: reader,member Sep 20 04:56:25.091813 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5f0a24f6f6994f45bd314d3009b0a572"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5f0a24f6f6994f45bd314d3009b0a572"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5f0a24f6f6994f45bd314d3009b0a572", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5f0a24f6f6994f45bd314d3009b0a572"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 04:56:25.091813 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant: tempest-ServerRescueNegativeTestJSON-447939399 Sep 20 04:56:25.091813 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Id: 5f0a24f6f6994f45bd314d3009b0a572 Sep 20 04:56:25.091813 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-447939399 Sep 20 04:56:25.091813 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User: tempest-ServerRescueNegativeTestJSON-447939399-project Sep 20 04:56:25.091813 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Id: default Sep 20 04:56:25.091813 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Name: Default Sep 20 04:56:25.091813 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Id: 49f80b68650940e8850cbd4f84a49ef4 Sep 20 04:56:25.091813 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Name: tempest-ServerRescueNegativeTestJSON-447939399-project Sep 20 04:56:25.091813 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: method: > Sep 20 04:56:25.091813 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: exception: Cannot 'detach_volume' instance 8df00208-8207-4ff8-9979-2e00926de906 while it is in vm_state rescued Sep 20 04:56:25.092618 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: action_args: {'server_id': '8df00208-8207-4ff8-9979-2e00926de906', 'id': 'f6b33c1f-e645-4e15-9aec-ec8a988a485d'} Sep 20 04:56:25.092618 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 04:56:25.092618 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:56:25.092618 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 20 04:56:25.092618 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 20 04:56:25.092618 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 20 04:56:25.092618 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 20 04:56:25.092618 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 20 04:56:25.092618 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 20 04:56:25.092618 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8df00208-8207-4ff8-9979-2e00926de906 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 20 04:56:25.092618 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:56:25.092618 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:56:25.092618 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:56:25.092618 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:56:25.092618 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:56:25.092618 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:56:25.092618 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 04:56:25.092618 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 04:56:25.092618 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 04:56:25.092618 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 04:56:25.094974 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 20 04:56:25.094974 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 20 04:56:25.094974 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 20 04:56:25.094974 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 20 04:56:25.094974 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 8df00208-8207-4ff8-9979-2e00926de906 while it is in vm_state rescued Sep 20 04:56:25.094974 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:56:25.094974 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:56:25.094974 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:56:25.094974 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:56:25.094974 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:56:25.094974 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:56:25.094974 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 04:56:25.094974 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 04:56:25.094974 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 8df00208-8207-4ff8-9979-2e00926de906 while it is in vm_state rescued Sep 20 04:56:25.094974 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:56:25.094974 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-b43f08bf-668a-4bf0-9b20-fb9411db7a0c tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Returning 409 to user: Cannot 'detach_volume' instance 8df00208-8207-4ff8-9979-2e00926de906 while it is in vm_state rescued {{(pid=126813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 04:56:25.096007 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-b43f08bf-668a-4bf0-9b20-fb9411db7a0c tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906/os-volume_attachments/f6b33c1f-e645-4e15-9aec-ec8a988a485d" status: 409 len: 152 microversion: 2.1 time: 0.103354 Sep 20 04:56:25.096007 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 279/429] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Sep 20 04:56:24 2022] DELETE /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906/os-volume_attachments/f6b33c1f-e645-4e15-9aec-ec8a988a485d => generated 152 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 20 04:56:25.096992 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-6c2ff227-1a9f-4d11-9b6a-8221c35a2dc7 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:25.097380 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-6c2ff227-1a9f-4d11-9b6a-8221c35a2dc7 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: 417f5e13-88b2-4fc7-b79a-fe70372ed20d] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:25.156044 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-6c2ff227-1a9f-4d11-9b6a-8221c35a2dc7 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:25.161075 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-6c2ff227-1a9f-4d11-9b6a-8221c35a2dc7 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d" status: 200 len: 1093 microversion: 2.1 time: 0.067855 Sep 20 04:56:25.161639 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 280/430] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:25 2022] GET /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:56:25.166074 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-1dc43d1e-44b1-4a95-b916-f54d37c4fa85 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:56:25.166613 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-1dc43d1e-44b1-4a95-b916-f54d37c4fa85 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:25.172870 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1dc43d1e-44b1-4a95-b916-f54d37c4fa85 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:25.173383 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1dc43d1e-44b1-4a95-b916-f54d37c4fa85 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:25.173839 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1dc43d1e-44b1-4a95-b916-f54d37c4fa85 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:25.174531 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1dc43d1e-44b1-4a95-b916-f54d37c4fa85 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:25.175172 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1dc43d1e-44b1-4a95-b916-f54d37c4fa85 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:25.175901 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1dc43d1e-44b1-4a95-b916-f54d37c4fa85 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:25.247526 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-1dc43d1e-44b1-4a95-b916-f54d37c4fa85 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "POST /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906/action" status: 202 len: 0 microversion: 2.1 time: 0.084672 Sep 20 04:56:25.248649 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 281/431] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Sep 20 04:56:25 2022] POST /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 20 04:56:25.256660 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-cd0b925b-9677-45d1-a785-af3b802d9a39 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:25.257624 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-cd0b925b-9677-45d1-a785-af3b802d9a39 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:25.264816 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-cd0b925b-9677-45d1-a785-af3b802d9a39 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:25.265370 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-cd0b925b-9677-45d1-a785-af3b802d9a39 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:25.265903 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-cd0b925b-9677-45d1-a785-af3b802d9a39 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:25.266562 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-cd0b925b-9677-45d1-a785-af3b802d9a39 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:25.267260 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-cd0b925b-9677-45d1-a785-af3b802d9a39 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:25.267766 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-cd0b925b-9677-45d1-a785-af3b802d9a39 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:25.498093 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-cd0b925b-9677-45d1-a785-af3b802d9a39 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:25.507892 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-cd0b925b-9677-45d1-a785-af3b802d9a39 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906" status: 200 len: 1724 microversion: 2.1 time: 0.254976 Sep 20 04:56:25.508484 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 282/432] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:25 2022] GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906 => generated 1724 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:56:25.934354 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-7aaa90c7-a667-4e76-bbb6-50c5084ab262 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:25.935490 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-7aaa90c7-a667-4e76-bbb6-50c5084ab262 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] [instance: d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:25.941689 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7aaa90c7-a667-4e76-bbb6-50c5084ab262 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:25.942175 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7aaa90c7-a667-4e76-bbb6-50c5084ab262 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:25.942612 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7aaa90c7-a667-4e76-bbb6-50c5084ab262 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:25.943300 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7aaa90c7-a667-4e76-bbb6-50c5084ab262 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:25.943749 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7aaa90c7-a667-4e76-bbb6-50c5084ab262 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:25.944176 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7aaa90c7-a667-4e76-bbb6-50c5084ab262 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:26.023706 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.objects.instance [None req-7aaa90c7-a667-4e76-bbb6-50c5084ab262 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lazy-loading 'services' on Instance uuid d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d {{(pid=126813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 04:56:26.094295 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-7aaa90c7-a667-4e76-bbb6-50c5084ab262 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d/os-volume_attachments/03806730-86c6-4435-921b-cb5de0a89237" status: 202 len: 0 microversion: 2.1 time: 0.163795 Sep 20 04:56:26.094917 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 283/433] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Sep 20 04:56:25 2022] DELETE /compute/v2.1/servers/d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d/os-volume_attachments/03806730-86c6-4435-921b-cb5de0a89237 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 20 04:56:26.183790 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-0b98b3ca-6691-4ef7-b519-0b6b75ffed19 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:26.184491 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-0b98b3ca-6691-4ef7-b519-0b6b75ffed19 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: 417f5e13-88b2-4fc7-b79a-fe70372ed20d] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:26.191702 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0b98b3ca-6691-4ef7-b519-0b6b75ffed19 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:26.192269 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0b98b3ca-6691-4ef7-b519-0b6b75ffed19 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:26.192824 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0b98b3ca-6691-4ef7-b519-0b6b75ffed19 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:26.193582 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0b98b3ca-6691-4ef7-b519-0b6b75ffed19 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:26.194097 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0b98b3ca-6691-4ef7-b519-0b6b75ffed19 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:26.194590 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0b98b3ca-6691-4ef7-b519-0b6b75ffed19 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:26.266243 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-0b98b3ca-6691-4ef7-b519-0b6b75ffed19 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:26.274659 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-0b98b3ca-6691-4ef7-b519-0b6b75ffed19 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d" status: 200 len: 1191 microversion: 2.1 time: 0.095131 Sep 20 04:56:26.275238 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 284/434] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:26 2022] GET /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d => generated 1191 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:56:26.531884 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-87263eb6-554a-4b82-bfe2-8a8844af9cfd tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:26.532490 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-87263eb6-554a-4b82-bfe2-8a8844af9cfd tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:26.538488 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-87263eb6-554a-4b82-bfe2-8a8844af9cfd tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:26.538972 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-87263eb6-554a-4b82-bfe2-8a8844af9cfd tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:26.539414 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-87263eb6-554a-4b82-bfe2-8a8844af9cfd tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:26.540098 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-87263eb6-554a-4b82-bfe2-8a8844af9cfd tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:26.540553 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-87263eb6-554a-4b82-bfe2-8a8844af9cfd tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:26.541008 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-87263eb6-554a-4b82-bfe2-8a8844af9cfd tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:26.672090 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-87263eb6-554a-4b82-bfe2-8a8844af9cfd tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:26.680330 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-87263eb6-554a-4b82-bfe2-8a8844af9cfd tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906" status: 200 len: 1724 microversion: 2.1 time: 0.152993 Sep 20 04:56:26.680926 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 285/435] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:26 2022] GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:56:27.297696 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-801b7fb4-a87f-4211-92d2-4e1b5e5615a8 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:27.298366 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-801b7fb4-a87f-4211-92d2-4e1b5e5615a8 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: 417f5e13-88b2-4fc7-b79a-fe70372ed20d] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:27.304840 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-801b7fb4-a87f-4211-92d2-4e1b5e5615a8 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:27.305317 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-801b7fb4-a87f-4211-92d2-4e1b5e5615a8 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:27.305750 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-801b7fb4-a87f-4211-92d2-4e1b5e5615a8 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:27.306423 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-801b7fb4-a87f-4211-92d2-4e1b5e5615a8 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:27.306870 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-801b7fb4-a87f-4211-92d2-4e1b5e5615a8 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:27.307288 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-801b7fb4-a87f-4211-92d2-4e1b5e5615a8 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:27.366914 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-801b7fb4-a87f-4211-92d2-4e1b5e5615a8 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:27.375107 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-801b7fb4-a87f-4211-92d2-4e1b5e5615a8 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d" status: 200 len: 1209 microversion: 2.1 time: 0.081549 Sep 20 04:56:27.375661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 286/436] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:27 2022] GET /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d => generated 1209 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:56:27.703787 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-f45ca198-d20f-4321-82a3-41fcfee07ac7 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:27.704397 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-f45ca198-d20f-4321-82a3-41fcfee07ac7 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:27.710304 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f45ca198-d20f-4321-82a3-41fcfee07ac7 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:27.710787 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f45ca198-d20f-4321-82a3-41fcfee07ac7 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:27.711223 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f45ca198-d20f-4321-82a3-41fcfee07ac7 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:27.711905 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f45ca198-d20f-4321-82a3-41fcfee07ac7 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:27.712355 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f45ca198-d20f-4321-82a3-41fcfee07ac7 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:27.712824 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f45ca198-d20f-4321-82a3-41fcfee07ac7 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:27.850224 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-f45ca198-d20f-4321-82a3-41fcfee07ac7 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:27.859160 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-f45ca198-d20f-4321-82a3-41fcfee07ac7 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906" status: 200 len: 1724 microversion: 2.1 time: 0.159386 Sep 20 04:56:27.859722 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 287/437] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:27 2022] GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:56:28.399259 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-30711cd2-a51f-42a1-b86c-9a59b40b6e5c tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:28.399899 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-30711cd2-a51f-42a1-b86c-9a59b40b6e5c tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: 417f5e13-88b2-4fc7-b79a-fe70372ed20d] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:28.406428 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:56:28.416942 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-30711cd2-a51f-42a1-b86c-9a59b40b6e5c tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:28.418469 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-30711cd2-a51f-42a1-b86c-9a59b40b6e5c tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:28.419070 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-30711cd2-a51f-42a1-b86c-9a59b40b6e5c tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:28.420375 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-30711cd2-a51f-42a1-b86c-9a59b40b6e5c tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:28.421123 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-30711cd2-a51f-42a1-b86c-9a59b40b6e5c tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:28.421813 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-30711cd2-a51f-42a1-b86c-9a59b40b6e5c tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:28.507860 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-30711cd2-a51f-42a1-b86c-9a59b40b6e5c tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:28.516396 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-30711cd2-a51f-42a1-b86c-9a59b40b6e5c tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d" status: 200 len: 1209 microversion: 2.1 time: 0.121081 Sep 20 04:56:28.517363 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 288/438] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:28 2022] GET /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d => generated 1209 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:56:28.882137 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-0057071e-0eea-4af3-85a7-c989bcc6a54d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:28.882742 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-0057071e-0eea-4af3-85a7-c989bcc6a54d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:28.888780 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0057071e-0eea-4af3-85a7-c989bcc6a54d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:28.889257 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0057071e-0eea-4af3-85a7-c989bcc6a54d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:28.889684 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0057071e-0eea-4af3-85a7-c989bcc6a54d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:28.890363 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0057071e-0eea-4af3-85a7-c989bcc6a54d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:28.890804 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0057071e-0eea-4af3-85a7-c989bcc6a54d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:28.891220 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0057071e-0eea-4af3-85a7-c989bcc6a54d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:29.105455 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-0057071e-0eea-4af3-85a7-c989bcc6a54d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:29.113724 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-0057071e-0eea-4af3-85a7-c989bcc6a54d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906" status: 200 len: 1730 microversion: 2.1 time: 0.235483 Sep 20 04:56:29.114292 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 289/439] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:28 2022] GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906 => generated 1730 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:56:29.139523 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-4a9babab-25e3-4ddb-9bd1-2b3a1a8d6442 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:29.140022 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-4a9babab-25e3-4ddb-9bd1-2b3a1a8d6442 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:29.146474 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4a9babab-25e3-4ddb-9bd1-2b3a1a8d6442 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:29.146956 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4a9babab-25e3-4ddb-9bd1-2b3a1a8d6442 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:29.147390 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4a9babab-25e3-4ddb-9bd1-2b3a1a8d6442 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:29.148074 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4a9babab-25e3-4ddb-9bd1-2b3a1a8d6442 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:29.148524 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4a9babab-25e3-4ddb-9bd1-2b3a1a8d6442 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:29.148966 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4a9babab-25e3-4ddb-9bd1-2b3a1a8d6442 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:29.277961 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-4a9babab-25e3-4ddb-9bd1-2b3a1a8d6442 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.142683 Sep 20 04:56:29.279496 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 290/440] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Sep 20 04:56:29 2022] GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906/os-interface => generated 285 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:56:29.373941 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-fe18e179-266f-4ab4-abe7-62dc0acf7902 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:29.374840 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-fe18e179-266f-4ab4-abe7-62dc0acf7902 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] [instance: d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:29.382716 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fe18e179-266f-4ab4-abe7-62dc0acf7902 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:29.383361 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fe18e179-266f-4ab4-abe7-62dc0acf7902 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:29.384037 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fe18e179-266f-4ab4-abe7-62dc0acf7902 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:29.384864 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fe18e179-266f-4ab4-abe7-62dc0acf7902 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:29.385398 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fe18e179-266f-4ab4-abe7-62dc0acf7902 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:29.386059 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fe18e179-266f-4ab4-abe7-62dc0acf7902 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:29.416489 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-fe18e179-266f-4ab4-abe7-62dc0acf7902 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] [instance: d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d] Going to try to terminate instance {{(pid=126813) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 20 04:56:29.448207 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:56:29.515957 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-fe18e179-266f-4ab4-abe7-62dc0acf7902 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d" status: 204 len: 0 microversion: 2.1 time: 0.146440 Sep 20 04:56:29.520030 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 291/441] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Sep 20 04:56:29 2022] DELETE /compute/v2.1/servers/d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 20 04:56:29.526483 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-743135e1-c0bc-48a6-a0ee-ece036361bab tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:29.527480 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-743135e1-c0bc-48a6-a0ee-ece036361bab tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] [instance: d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:29.536890 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-743135e1-c0bc-48a6-a0ee-ece036361bab tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:29.537698 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-743135e1-c0bc-48a6-a0ee-ece036361bab tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:29.538302 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-743135e1-c0bc-48a6-a0ee-ece036361bab tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:29.539343 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-743135e1-c0bc-48a6-a0ee-ece036361bab tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:29.539959 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-743135e1-c0bc-48a6-a0ee-ece036361bab tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:29.540552 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-743135e1-c0bc-48a6-a0ee-ece036361bab tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:29.765097 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-743135e1-c0bc-48a6-a0ee-ece036361bab tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d877f0c71f4e18854813780214ed6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725d386301d648de85fd6c4767250c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:29.779181 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-743135e1-c0bc-48a6-a0ee-ece036361bab tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] 10.222.0.27 "GET /compute/v2.1/servers/d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d" status: 200 len: 1513 microversion: 2.1 time: 0.257464 Sep 20 04:56:29.779784 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 292/442] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:29 2022] GET /compute/v2.1/servers/d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d => generated 1513 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:56:29.810406 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-1dd8436f-434b-4445-ae5f-e14549b655f8 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:29.811131 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-1dd8436f-434b-4445-ae5f-e14549b655f8 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: 417f5e13-88b2-4fc7-b79a-fe70372ed20d] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:29.820416 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1dd8436f-434b-4445-ae5f-e14549b655f8 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:29.821390 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1dd8436f-434b-4445-ae5f-e14549b655f8 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:29.822209 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1dd8436f-434b-4445-ae5f-e14549b655f8 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:29.822526 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1dd8436f-434b-4445-ae5f-e14549b655f8 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:29.822977 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1dd8436f-434b-4445-ae5f-e14549b655f8 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:29.823455 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1dd8436f-434b-4445-ae5f-e14549b655f8 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:30.033105 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-1dd8436f-434b-4445-ae5f-e14549b655f8 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:30.042616 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-1dd8436f-434b-4445-ae5f-e14549b655f8 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d" status: 200 len: 1276 microversion: 2.1 time: 0.241228 Sep 20 04:56:30.042616 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 293/443] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:29 2022] GET /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d => generated 1276 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:56:30.114261 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-6839c4bf-844f-4d1e-a473-58cb9aa71fff req-36a2df57-52cd-4020-9d03-46e7791086e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "417f5e13-88b2-4fc7-b79a-fe70372ed20d", "tag": "6b28a7ec-b466-45f0-86a8-63563916d1bd"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:56:30.124089 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-6839c4bf-844f-4d1e-a473-58cb9aa71fff req-36a2df57-52cd-4020-9d03-46e7791086e4 service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:30.124629 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-6839c4bf-844f-4d1e-a473-58cb9aa71fff req-36a2df57-52cd-4020-9d03-46e7791086e4 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:30.125173 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-6839c4bf-844f-4d1e-a473-58cb9aa71fff req-36a2df57-52cd-4020-9d03-46e7791086e4 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:30.137962 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-6839c4bf-844f-4d1e-a473-58cb9aa71fff req-36a2df57-52cd-4020-9d03-46e7791086e4 service nova] Creating event network-changed:6b28a7ec-b466-45f0-86a8-63563916d1bd for instance 417f5e13-88b2-4fc7-b79a-fe70372ed20d on hv-cinder-75671 Sep 20 04:56:30.143499 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-6839c4bf-844f-4d1e-a473-58cb9aa71fff req-36a2df57-52cd-4020-9d03-46e7791086e4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032858 Sep 20 04:56:30.144348 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 294/444] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 04:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:56:30.260751 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-38614647-5fdc-4b6c-9f41-4f068ce199d2 req-8d9b0884-5f81-4928-88b9-21733d7c179b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8df00208-8207-4ff8-9979-2e00926de906", "tag": "0d0b44d0-2172-48f9-b9c5-88e71d3e7975"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:56:30.274745 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-38614647-5fdc-4b6c-9f41-4f068ce199d2 req-8d9b0884-5f81-4928-88b9-21733d7c179b service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:30.276041 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-38614647-5fdc-4b6c-9f41-4f068ce199d2 req-8d9b0884-5f81-4928-88b9-21733d7c179b service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:30.276472 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-38614647-5fdc-4b6c-9f41-4f068ce199d2 req-8d9b0884-5f81-4928-88b9-21733d7c179b service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:30.290268 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-38614647-5fdc-4b6c-9f41-4f068ce199d2 req-8d9b0884-5f81-4928-88b9-21733d7c179b service nova] Creating event network-changed:0d0b44d0-2172-48f9-b9c5-88e71d3e7975 for instance 8df00208-8207-4ff8-9979-2e00926de906 on hv-cinder-75671 Sep 20 04:56:30.295830 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-38614647-5fdc-4b6c-9f41-4f068ce199d2 req-8d9b0884-5f81-4928-88b9-21733d7c179b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039598 Sep 20 04:56:30.296431 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 295/445] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 04:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 04:56:30.808186 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-3416fdf7-9b89-4cf2-bec4-4e0e221504aa tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:30.808950 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-3416fdf7-9b89-4cf2-bec4-4e0e221504aa tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] [instance: d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:30.816335 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3416fdf7-9b89-4cf2-bec4-4e0e221504aa tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:30.817038 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3416fdf7-9b89-4cf2-bec4-4e0e221504aa tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:30.817561 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3416fdf7-9b89-4cf2-bec4-4e0e221504aa tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:30.818848 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3416fdf7-9b89-4cf2-bec4-4e0e221504aa tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:30.819427 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3416fdf7-9b89-4cf2-bec4-4e0e221504aa tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:30.820042 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3416fdf7-9b89-4cf2-bec4-4e0e221504aa tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:30.957632 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-3416fdf7-9b89-4cf2-bec4-4e0e221504aa tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d877f0c71f4e18854813780214ed6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725d386301d648de85fd6c4767250c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:30.965721 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-3416fdf7-9b89-4cf2-bec4-4e0e221504aa tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] 10.222.0.27 "GET /compute/v2.1/servers/d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d" status: 200 len: 1513 microversion: 2.1 time: 0.161880 Sep 20 04:56:30.966302 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 296/446] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:30 2022] GET /compute/v2.1/servers/d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:56:31.066717 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-45757a20-f2ec-4c6e-87a8-be68c276d52b tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:31.067462 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-45757a20-f2ec-4c6e-87a8-be68c276d52b tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: 417f5e13-88b2-4fc7-b79a-fe70372ed20d] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:31.073933 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-45757a20-f2ec-4c6e-87a8-be68c276d52b tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:31.074570 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-45757a20-f2ec-4c6e-87a8-be68c276d52b tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:31.075027 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-45757a20-f2ec-4c6e-87a8-be68c276d52b tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:31.076487 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-45757a20-f2ec-4c6e-87a8-be68c276d52b tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:31.076963 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-45757a20-f2ec-4c6e-87a8-be68c276d52b tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:31.077414 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-45757a20-f2ec-4c6e-87a8-be68c276d52b tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:31.209795 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-45757a20-f2ec-4c6e-87a8-be68c276d52b tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:31.217596 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-45757a20-f2ec-4c6e-87a8-be68c276d52b tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d" status: 200 len: 1276 microversion: 2.1 time: 0.154819 Sep 20 04:56:31.218156 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 297/447] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:31 2022] GET /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d => generated 1276 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:56:31.988249 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-381c7ffa-7168-43ad-855e-c6b7a13e1ac3 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:31.988971 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-381c7ffa-7168-43ad-855e-c6b7a13e1ac3 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] [instance: d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:31.995306 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-381c7ffa-7168-43ad-855e-c6b7a13e1ac3 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:31.996072 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-381c7ffa-7168-43ad-855e-c6b7a13e1ac3 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:31.996258 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-381c7ffa-7168-43ad-855e-c6b7a13e1ac3 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:31.996986 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-381c7ffa-7168-43ad-855e-c6b7a13e1ac3 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:31.997428 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-381c7ffa-7168-43ad-855e-c6b7a13e1ac3 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:31.997847 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-381c7ffa-7168-43ad-855e-c6b7a13e1ac3 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:32.136377 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-381c7ffa-7168-43ad-855e-c6b7a13e1ac3 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d877f0c71f4e18854813780214ed6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725d386301d648de85fd6c4767250c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:32.145724 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-381c7ffa-7168-43ad-855e-c6b7a13e1ac3 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] 10.222.0.27 "GET /compute/v2.1/servers/d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d" status: 200 len: 1471 microversion: 2.1 time: 0.161183 Sep 20 04:56:32.146454 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 298/448] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:31 2022] GET /compute/v2.1/servers/d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d => generated 1471 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:56:32.240386 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-e863e484-8cae-4c9e-a734-e9b025472739 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:32.241426 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-e863e484-8cae-4c9e-a734-e9b025472739 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: 417f5e13-88b2-4fc7-b79a-fe70372ed20d] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:32.247846 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e863e484-8cae-4c9e-a734-e9b025472739 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:32.248342 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e863e484-8cae-4c9e-a734-e9b025472739 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:32.248981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e863e484-8cae-4c9e-a734-e9b025472739 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:32.249680 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e863e484-8cae-4c9e-a734-e9b025472739 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:32.251681 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e863e484-8cae-4c9e-a734-e9b025472739 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:32.252345 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e863e484-8cae-4c9e-a734-e9b025472739 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:32.475329 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-e863e484-8cae-4c9e-a734-e9b025472739 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:32.483422 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-e863e484-8cae-4c9e-a734-e9b025472739 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d" status: 200 len: 1264 microversion: 2.1 time: 0.246887 Sep 20 04:56:32.486862 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 299/449] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:32 2022] GET /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d => generated 1264 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:56:32.488453 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-31727e77-8358-4843-8efd-3c85fca8216b req-aba0e204-fcc1-4234-ae5f-2fc4fcaa587f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8df00208-8207-4ff8-9979-2e00926de906", "tag": "0d0b44d0-2172-48f9-b9c5-88e71d3e7975"}, {"server_uuid": "d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d", "name": "network-vif-deleted", "tag": "31e662db-2a8c-47a3-862e-c1f0f71c017f"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:56:32.500130 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-31727e77-8358-4843-8efd-3c85fca8216b req-aba0e204-fcc1-4234-ae5f-2fc4fcaa587f service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:32.500757 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-31727e77-8358-4843-8efd-3c85fca8216b req-aba0e204-fcc1-4234-ae5f-2fc4fcaa587f service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:32.501057 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-31727e77-8358-4843-8efd-3c85fca8216b req-aba0e204-fcc1-4234-ae5f-2fc4fcaa587f service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:32.515437 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-31727e77-8358-4843-8efd-3c85fca8216b req-aba0e204-fcc1-4234-ae5f-2fc4fcaa587f service nova] Creating event network-changed:0d0b44d0-2172-48f9-b9c5-88e71d3e7975 for instance 8df00208-8207-4ff8-9979-2e00926de906 on hv-cinder-75671 Sep 20 04:56:32.515948 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-31727e77-8358-4843-8efd-3c85fca8216b req-aba0e204-fcc1-4234-ae5f-2fc4fcaa587f service nova] Creating event network-vif-deleted:31e662db-2a8c-47a3-862e-c1f0f71c017f for instance d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d on hv-cinder-75671 Sep 20 04:56:32.522416 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-31727e77-8358-4843-8efd-3c85fca8216b req-aba0e204-fcc1-4234-ae5f-2fc4fcaa587f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.037261 Sep 20 04:56:32.522996 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 300/450] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 04:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:56:33.172071 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-4133cb22-b50c-4ada-bd91-5dd7b2201837 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:33.173493 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-4133cb22-b50c-4ada-bd91-5dd7b2201837 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] [instance: d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:33.183643 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4133cb22-b50c-4ada-bd91-5dd7b2201837 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:33.186035 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4133cb22-b50c-4ada-bd91-5dd7b2201837 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:33.186674 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4133cb22-b50c-4ada-bd91-5dd7b2201837 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:33.187438 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4133cb22-b50c-4ada-bd91-5dd7b2201837 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:33.188155 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4133cb22-b50c-4ada-bd91-5dd7b2201837 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:33.188657 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4133cb22-b50c-4ada-bd91-5dd7b2201837 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:33.205482 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.wsgi [None req-4133cb22-b50c-4ada-bd91-5dd7b2201837 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] HTTP exception thrown: Instance d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d could not be found. Sep 20 04:56:33.207138 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-4133cb22-b50c-4ada-bd91-5dd7b2201837 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Request method failure captured: Sep 20 04:56:33.207138 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: request: GET /compute/v2.1/servers/d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d HTTP/1.1 Sep 20 04:56:33.207138 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept: application/json Sep 20 04:56:33.207138 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept-Encoding: identity Sep 20 04:56:33.207138 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Connection: close Sep 20 04:56:33.207138 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Length: 0 Sep 20 04:56:33.207138 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Type: application/json Sep 20 04:56:33.207138 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Host: 10.222.0.27 Sep 20 04:56:33.207138 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Openstack-System-Scope: None Sep 20 04:56:33.207138 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: User-Agent: python-urllib3/1.26.12 Sep 20 04:56:33.207138 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Auth-Token: gAAAAABjKUd5he8Od3uPWtcdMRy0wEnVrfT2OkG6aq5GDRuRylJ2VONMNWLgnc7Xf4tjlmODucdoyKBSLioDnQ0F3tyfuQqpcMGc2JyvRH8KYwZkpA00UdWWrwxidQL5Wl_5S_39qD_v5cEta1MBlJJtA7M78x6qnB4-xXKZd9Cyu6TGkYQkaKQ Sep 20 04:56:33.207138 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Id: None Sep 20 04:56:33.207138 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Name: None Sep 20 04:56:33.207138 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Identity-Status: Confirmed Sep 20 04:56:33.207138 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Is-Admin-Project: True Sep 20 04:56:33.207138 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Id: default Sep 20 04:56:33.207138 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Name: Default Sep 20 04:56:33.207138 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Id: 725d386301d648de85fd6c4767250c58 Sep 20 04:56:33.207138 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Name: tempest-VolumesSnapshotTestJSON-315607713 Sep 20 04:56:33.207138 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Role: reader,member Sep 20 04:56:33.207138 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Roles: reader,member Sep 20 04:56:33.208695 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/725d386301d648de85fd6c4767250c58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/725d386301d648de85fd6c4767250c58"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_725d386301d648de85fd6c4767250c58", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/725d386301d648de85fd6c4767250c58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 04:56:33.208695 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant: tempest-VolumesSnapshotTestJSON-315607713 Sep 20 04:56:33.208695 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Id: 725d386301d648de85fd6c4767250c58 Sep 20 04:56:33.208695 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-315607713 Sep 20 04:56:33.208695 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User: tempest-VolumesSnapshotTestJSON-315607713-project Sep 20 04:56:33.208695 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Id: default Sep 20 04:56:33.208695 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Name: Default Sep 20 04:56:33.208695 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Id: b3d877f0c71f4e18854813780214ed6a Sep 20 04:56:33.208695 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Name: tempest-VolumesSnapshotTestJSON-315607713-project Sep 20 04:56:33.208695 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: method: > Sep 20 04:56:33.208695 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: exception: Instance d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d could not be found. Sep 20 04:56:33.208695 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: action_args: {'id': 'd2aeb854-27cf-4c41-a9c6-dc40c65d3c8d'} Sep 20 04:56:33.209643 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 04:56:33.209643 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:56:33.209643 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 04:56:33.209643 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 04:56:33.209643 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 04:56:33.209643 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 04:56:33.209643 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 04:56:33.209643 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 04:56:33.209643 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 04:56:33.209643 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 04:56:33.209643 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d could not be found. Sep 20 04:56:33.209643 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:56:33.209643 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:56:33.209643 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:56:33.209643 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:56:33.209643 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:56:33.209643 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:56:33.209643 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 04:56:33.209643 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 04:56:33.209643 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 04:56:33.211060 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 04:56:33.211060 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 04:56:33.211060 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 04:56:33.211060 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 04:56:33.211060 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 04:56:33.211060 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 04:56:33.211060 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 04:56:33.211060 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d could not be found. Sep 20 04:56:33.211060 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:56:33.211060 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:56:33.211060 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:56:33.211060 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:56:33.211060 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:56:33.211060 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:56:33.211060 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 04:56:33.211060 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 04:56:33.211060 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d could not be found. Sep 20 04:56:33.211060 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:56:33.212350 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-4133cb22-b50c-4ada-bd91-5dd7b2201837 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] Returning 404 to user: Instance d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d could not be found. {{(pid=126813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 04:56:33.212350 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-4133cb22-b50c-4ada-bd91-5dd7b2201837 tempest-VolumesSnapshotTestJSON-315607713 tempest-VolumesSnapshotTestJSON-315607713-project] 10.222.0.27 "GET /compute/v2.1/servers/d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d" status: 404 len: 111 microversion: 2.1 time: 0.041173 Sep 20 04:56:33.212350 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 301/451] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:33 2022] GET /compute/v2.1/servers/d2aeb854-27cf-4c41-a9c6-dc40c65d3c8d => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 20 04:56:33.507849 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-6499e143-9f64-40d0-88d2-07dde0249ef9 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:33.508937 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-6499e143-9f64-40d0-88d2-07dde0249ef9 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: 417f5e13-88b2-4fc7-b79a-fe70372ed20d] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:33.515894 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6499e143-9f64-40d0-88d2-07dde0249ef9 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:33.516462 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6499e143-9f64-40d0-88d2-07dde0249ef9 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:33.517599 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6499e143-9f64-40d0-88d2-07dde0249ef9 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:33.518752 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6499e143-9f64-40d0-88d2-07dde0249ef9 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:33.519384 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6499e143-9f64-40d0-88d2-07dde0249ef9 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:33.519873 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6499e143-9f64-40d0-88d2-07dde0249ef9 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:33.676669 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-6499e143-9f64-40d0-88d2-07dde0249ef9 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:33.685200 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-6499e143-9f64-40d0-88d2-07dde0249ef9 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d" status: 200 len: 1264 microversion: 2.1 time: 0.180848 Sep 20 04:56:33.685770 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 302/452] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:33 2022] GET /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d => generated 1264 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:56:34.708721 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-fb3ef753-05a4-4e54-b013-53faee163c73 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:34.709965 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-fb3ef753-05a4-4e54-b013-53faee163c73 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: 417f5e13-88b2-4fc7-b79a-fe70372ed20d] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:34.717617 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fb3ef753-05a4-4e54-b013-53faee163c73 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:34.718310 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fb3ef753-05a4-4e54-b013-53faee163c73 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:34.718911 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fb3ef753-05a4-4e54-b013-53faee163c73 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:34.719613 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fb3ef753-05a4-4e54-b013-53faee163c73 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:34.720069 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fb3ef753-05a4-4e54-b013-53faee163c73 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:34.720497 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fb3ef753-05a4-4e54-b013-53faee163c73 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:34.781346 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell0:SELECT=2 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:56:34.854109 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-fb3ef753-05a4-4e54-b013-53faee163c73 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:34.862549 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-fb3ef753-05a4-4e54-b013-53faee163c73 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d" status: 200 len: 1264 microversion: 2.1 time: 0.157768 Sep 20 04:56:34.863115 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 303/453] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:34 2022] GET /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:56:35.885032 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-69b1d5e2-3378-47fd-9ae2-4667b821d830 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:35.885641 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-69b1d5e2-3378-47fd-9ae2-4667b821d830 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: 417f5e13-88b2-4fc7-b79a-fe70372ed20d] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:35.887539 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell0:SELECT=8 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:56:35.893739 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-69b1d5e2-3378-47fd-9ae2-4667b821d830 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:35.894219 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-69b1d5e2-3378-47fd-9ae2-4667b821d830 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:35.894650 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-69b1d5e2-3378-47fd-9ae2-4667b821d830 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:35.895329 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-69b1d5e2-3378-47fd-9ae2-4667b821d830 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:35.895779 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-69b1d5e2-3378-47fd-9ae2-4667b821d830 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:35.896199 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-69b1d5e2-3378-47fd-9ae2-4667b821d830 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:36.022149 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-69b1d5e2-3378-47fd-9ae2-4667b821d830 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:36.030403 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-69b1d5e2-3378-47fd-9ae2-4667b821d830 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d" status: 200 len: 1264 microversion: 2.1 time: 0.149263 Sep 20 04:56:36.030971 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 304/454] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:35 2022] GET /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:56:37.053611 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-5d4ac209-7cd7-472d-8326-ad89672b68f3 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:37.054221 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-5d4ac209-7cd7-472d-8326-ad89672b68f3 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: 417f5e13-88b2-4fc7-b79a-fe70372ed20d] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:37.061149 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5d4ac209-7cd7-472d-8326-ad89672b68f3 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:37.061628 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5d4ac209-7cd7-472d-8326-ad89672b68f3 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:37.062066 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5d4ac209-7cd7-472d-8326-ad89672b68f3 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:37.062748 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5d4ac209-7cd7-472d-8326-ad89672b68f3 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:37.063210 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5d4ac209-7cd7-472d-8326-ad89672b68f3 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:37.063631 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5d4ac209-7cd7-472d-8326-ad89672b68f3 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:37.195646 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-5d4ac209-7cd7-472d-8326-ad89672b68f3 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:37.203394 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-5d4ac209-7cd7-472d-8326-ad89672b68f3 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d" status: 200 len: 1264 microversion: 2.1 time: 0.153753 Sep 20 04:56:37.203954 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 305/455] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:37 2022] GET /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:56:38.225983 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-960fcee2-5ed4-4ccb-911c-1a1e4d9af2ad tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:38.226590 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-960fcee2-5ed4-4ccb-911c-1a1e4d9af2ad tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: 417f5e13-88b2-4fc7-b79a-fe70372ed20d] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:38.233066 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-960fcee2-5ed4-4ccb-911c-1a1e4d9af2ad tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:38.233578 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-960fcee2-5ed4-4ccb-911c-1a1e4d9af2ad tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:38.234010 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-960fcee2-5ed4-4ccb-911c-1a1e4d9af2ad tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:38.234695 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-960fcee2-5ed4-4ccb-911c-1a1e4d9af2ad tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:38.235156 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-960fcee2-5ed4-4ccb-911c-1a1e4d9af2ad tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:38.235585 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-960fcee2-5ed4-4ccb-911c-1a1e4d9af2ad tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:38.362168 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-960fcee2-5ed4-4ccb-911c-1a1e4d9af2ad tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:38.369883 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-960fcee2-5ed4-4ccb-911c-1a1e4d9af2ad tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d" status: 200 len: 1264 microversion: 2.1 time: 0.147703 Sep 20 04:56:38.370445 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 306/456] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:38 2022] GET /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:56:39.393202 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-9ab4cd5f-119b-4588-977f-2f8e7e89425d tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:39.393912 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-9ab4cd5f-119b-4588-977f-2f8e7e89425d tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: 417f5e13-88b2-4fc7-b79a-fe70372ed20d] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:39.400144 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9ab4cd5f-119b-4588-977f-2f8e7e89425d tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:39.400650 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9ab4cd5f-119b-4588-977f-2f8e7e89425d tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:39.401090 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9ab4cd5f-119b-4588-977f-2f8e7e89425d tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:39.401838 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9ab4cd5f-119b-4588-977f-2f8e7e89425d tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:39.402287 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9ab4cd5f-119b-4588-977f-2f8e7e89425d tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:39.402709 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9ab4cd5f-119b-4588-977f-2f8e7e89425d tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:39.538562 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-9ab4cd5f-119b-4588-977f-2f8e7e89425d tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:39.546908 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-9ab4cd5f-119b-4588-977f-2f8e7e89425d tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d" status: 200 len: 1264 microversion: 2.1 time: 0.157821 Sep 20 04:56:39.547747 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 307/457] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:39 2022] GET /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:56:40.577119 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-6b9be1f1-29f8-4f64-8f2c-b536e3cb4603 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:40.577119 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-6b9be1f1-29f8-4f64-8f2c-b536e3cb4603 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: 417f5e13-88b2-4fc7-b79a-fe70372ed20d] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:40.579829 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6b9be1f1-29f8-4f64-8f2c-b536e3cb4603 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:40.579829 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6b9be1f1-29f8-4f64-8f2c-b536e3cb4603 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:40.579829 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6b9be1f1-29f8-4f64-8f2c-b536e3cb4603 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:40.580412 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6b9be1f1-29f8-4f64-8f2c-b536e3cb4603 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:40.580931 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6b9be1f1-29f8-4f64-8f2c-b536e3cb4603 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:40.581366 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6b9be1f1-29f8-4f64-8f2c-b536e3cb4603 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:40.724467 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-6b9be1f1-29f8-4f64-8f2c-b536e3cb4603 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:40.732731 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-6b9be1f1-29f8-4f64-8f2c-b536e3cb4603 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d" status: 200 len: 1264 microversion: 2.1 time: 0.166394 Sep 20 04:56:40.733339 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 308/458] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:40 2022] GET /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:56:41.756690 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-08c58c84-850b-4116-bc9c-034649428557 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:41.757369 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-08c58c84-850b-4116-bc9c-034649428557 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: 417f5e13-88b2-4fc7-b79a-fe70372ed20d] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:41.769035 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-08c58c84-850b-4116-bc9c-034649428557 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:41.769709 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-08c58c84-850b-4116-bc9c-034649428557 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:41.770231 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-08c58c84-850b-4116-bc9c-034649428557 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:41.771031 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-08c58c84-850b-4116-bc9c-034649428557 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:41.771543 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-08c58c84-850b-4116-bc9c-034649428557 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:41.772135 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-08c58c84-850b-4116-bc9c-034649428557 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:41.914923 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-08c58c84-850b-4116-bc9c-034649428557 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:41.920307 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:56:41.927132 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-08c58c84-850b-4116-bc9c-034649428557 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d" status: 200 len: 1264 microversion: 2.1 time: 0.175158 Sep 20 04:56:41.927694 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 309/459] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:41 2022] GET /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:56:41.932636 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-84690a6e-c3ba-47d0-8533-ac85fa593d27 req-df62cde5-e4a8-4b08-832e-4e208282f92d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "417f5e13-88b2-4fc7-b79a-fe70372ed20d", "name": "network-vif-plugged", "status": "completed", "tag": "6b28a7ec-b466-45f0-86a8-63563916d1bd"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:56:41.943168 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-84690a6e-c3ba-47d0-8533-ac85fa593d27 req-df62cde5-e4a8-4b08-832e-4e208282f92d service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:41.943645 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-84690a6e-c3ba-47d0-8533-ac85fa593d27 req-df62cde5-e4a8-4b08-832e-4e208282f92d service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:41.944077 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-84690a6e-c3ba-47d0-8533-ac85fa593d27 req-df62cde5-e4a8-4b08-832e-4e208282f92d service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:41.955122 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-84690a6e-c3ba-47d0-8533-ac85fa593d27 req-df62cde5-e4a8-4b08-832e-4e208282f92d service nova] Creating event network-vif-plugged:6b28a7ec-b466-45f0-86a8-63563916d1bd for instance 417f5e13-88b2-4fc7-b79a-fe70372ed20d on hv-cinder-75671 Sep 20 04:56:41.959838 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-84690a6e-c3ba-47d0-8533-ac85fa593d27 req-df62cde5-e4a8-4b08-832e-4e208282f92d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031017 Sep 20 04:56:41.960422 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 310/460] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 04:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:56:42.951372 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-6f2525a6-d8ad-4230-b73f-16066db41af5 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:42.952074 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-6f2525a6-d8ad-4230-b73f-16066db41af5 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: 417f5e13-88b2-4fc7-b79a-fe70372ed20d] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:42.958299 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6f2525a6-d8ad-4230-b73f-16066db41af5 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:42.958784 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6f2525a6-d8ad-4230-b73f-16066db41af5 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:42.959223 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6f2525a6-d8ad-4230-b73f-16066db41af5 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:42.959942 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6f2525a6-d8ad-4230-b73f-16066db41af5 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:42.960396 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6f2525a6-d8ad-4230-b73f-16066db41af5 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:42.960858 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6f2525a6-d8ad-4230-b73f-16066db41af5 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:43.093502 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-6f2525a6-d8ad-4230-b73f-16066db41af5 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:43.101609 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-6f2525a6-d8ad-4230-b73f-16066db41af5 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d" status: 200 len: 1264 microversion: 2.1 time: 0.154911 Sep 20 04:56:43.102201 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 311/461] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:42 2022] GET /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:56:44.125147 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-6fd1cc9e-1164-4cde-939e-065d92e47d04 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:44.125770 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-6fd1cc9e-1164-4cde-939e-065d92e47d04 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: 417f5e13-88b2-4fc7-b79a-fe70372ed20d] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:44.132135 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6fd1cc9e-1164-4cde-939e-065d92e47d04 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:44.132648 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6fd1cc9e-1164-4cde-939e-065d92e47d04 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:44.133093 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6fd1cc9e-1164-4cde-939e-065d92e47d04 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:44.133784 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6fd1cc9e-1164-4cde-939e-065d92e47d04 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:44.134234 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6fd1cc9e-1164-4cde-939e-065d92e47d04 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:44.134659 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6fd1cc9e-1164-4cde-939e-065d92e47d04 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:44.261135 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-6fd1cc9e-1164-4cde-939e-065d92e47d04 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:44.269103 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-6fd1cc9e-1164-4cde-939e-065d92e47d04 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d" status: 200 len: 1264 microversion: 2.1 time: 0.148449 Sep 20 04:56:44.269669 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 312/462] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:44 2022] GET /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:56:45.292297 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-6dce380c-d86d-41c5-9469-960a6444709d tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:45.292996 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-6dce380c-d86d-41c5-9469-960a6444709d tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: 417f5e13-88b2-4fc7-b79a-fe70372ed20d] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:45.299406 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6dce380c-d86d-41c5-9469-960a6444709d tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:45.299883 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6dce380c-d86d-41c5-9469-960a6444709d tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:45.300312 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6dce380c-d86d-41c5-9469-960a6444709d tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:45.301020 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6dce380c-d86d-41c5-9469-960a6444709d tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:45.301467 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6dce380c-d86d-41c5-9469-960a6444709d tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:45.301884 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6dce380c-d86d-41c5-9469-960a6444709d tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:45.427479 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-6dce380c-d86d-41c5-9469-960a6444709d tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:45.435272 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-6dce380c-d86d-41c5-9469-960a6444709d tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d" status: 200 len: 1264 microversion: 2.1 time: 0.146960 Sep 20 04:56:45.435828 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 313/463] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:45 2022] GET /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d => generated 1264 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:56:46.459338 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-4132c521-c8c1-4f27-8c4b-fe456a246db4 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:46.459953 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-4132c521-c8c1-4f27-8c4b-fe456a246db4 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: 417f5e13-88b2-4fc7-b79a-fe70372ed20d] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:46.466313 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4132c521-c8c1-4f27-8c4b-fe456a246db4 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:46.466793 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4132c521-c8c1-4f27-8c4b-fe456a246db4 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:46.467222 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4132c521-c8c1-4f27-8c4b-fe456a246db4 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:46.467904 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4132c521-c8c1-4f27-8c4b-fe456a246db4 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:46.468347 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4132c521-c8c1-4f27-8c4b-fe456a246db4 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:46.468801 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4132c521-c8c1-4f27-8c4b-fe456a246db4 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:46.602482 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-4132c521-c8c1-4f27-8c4b-fe456a246db4 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:46.611141 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-4132c521-c8c1-4f27-8c4b-fe456a246db4 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d" status: 200 len: 1264 microversion: 2.1 time: 0.155545 Sep 20 04:56:46.612073 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 314/464] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:46 2022] GET /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:56:47.634344 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-974d69ab-a3b5-4910-a235-4128d29b412f tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:47.634981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-974d69ab-a3b5-4910-a235-4128d29b412f tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: 417f5e13-88b2-4fc7-b79a-fe70372ed20d] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:47.642163 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-974d69ab-a3b5-4910-a235-4128d29b412f tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:47.642640 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-974d69ab-a3b5-4910-a235-4128d29b412f tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:47.643078 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-974d69ab-a3b5-4910-a235-4128d29b412f tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:47.643750 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-974d69ab-a3b5-4910-a235-4128d29b412f tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:47.644202 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-974d69ab-a3b5-4910-a235-4128d29b412f tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:47.644640 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-974d69ab-a3b5-4910-a235-4128d29b412f tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:47.773705 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-974d69ab-a3b5-4910-a235-4128d29b412f tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:47.782180 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-974d69ab-a3b5-4910-a235-4128d29b412f tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d" status: 200 len: 1451 microversion: 2.1 time: 0.151601 Sep 20 04:56:47.782971 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 315/465] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:47 2022] GET /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:56:47.804867 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-80cf9198-344c-48b1-b4a6-d5ea7b77cdc9 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:47.805468 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-80cf9198-344c-48b1-b4a6-d5ea7b77cdc9 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: 417f5e13-88b2-4fc7-b79a-fe70372ed20d] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:47.812158 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-80cf9198-344c-48b1-b4a6-d5ea7b77cdc9 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:47.812661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-80cf9198-344c-48b1-b4a6-d5ea7b77cdc9 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:47.813098 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-80cf9198-344c-48b1-b4a6-d5ea7b77cdc9 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:47.813774 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-80cf9198-344c-48b1-b4a6-d5ea7b77cdc9 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:47.814221 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-80cf9198-344c-48b1-b4a6-d5ea7b77cdc9 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:47.814641 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-80cf9198-344c-48b1-b4a6-d5ea7b77cdc9 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:47.951430 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-80cf9198-344c-48b1-b4a6-d5ea7b77cdc9 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:56:47.959400 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-80cf9198-344c-48b1-b4a6-d5ea7b77cdc9 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d" status: 200 len: 1451 microversion: 2.1 time: 0.158152 Sep 20 04:56:47.959965 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 316/466] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:56:47 2022] GET /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:56:49.650926 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-a29a6040-ae8c-4acb-82ea-6345cfaf4cf6 req-ae55b4b3-a05d-414d-bdfb-4bbd150363ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "417f5e13-88b2-4fc7-b79a-fe70372ed20d", "tag": "6b28a7ec-b466-45f0-86a8-63563916d1bd"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:56:49.661460 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-a29a6040-ae8c-4acb-82ea-6345cfaf4cf6 req-ae55b4b3-a05d-414d-bdfb-4bbd150363ec service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:49.662069 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-a29a6040-ae8c-4acb-82ea-6345cfaf4cf6 req-ae55b4b3-a05d-414d-bdfb-4bbd150363ec service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:49.662464 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-a29a6040-ae8c-4acb-82ea-6345cfaf4cf6 req-ae55b4b3-a05d-414d-bdfb-4bbd150363ec service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:49.674822 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-a29a6040-ae8c-4acb-82ea-6345cfaf4cf6 req-ae55b4b3-a05d-414d-bdfb-4bbd150363ec service nova] Creating event network-changed:6b28a7ec-b466-45f0-86a8-63563916d1bd for instance 417f5e13-88b2-4fc7-b79a-fe70372ed20d on hv-cinder-75671 Sep 20 04:56:49.681462 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-a29a6040-ae8c-4acb-82ea-6345cfaf4cf6 req-ae55b4b3-a05d-414d-bdfb-4bbd150363ec service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034010 Sep 20 04:56:49.682162 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 317/467] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 04:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 04:56:57.838371 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-327f6d99-aed9-4446-bf89-071a6c4ad65f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:56:57.839063 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-327f6d99-aed9-4446-bf89-071a6c4ad65f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 08dd20c3-27f2-4e1a-b083-c17cb2171a16] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:57.845332 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-327f6d99-aed9-4446-bf89-071a6c4ad65f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:57.845814 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-327f6d99-aed9-4446-bf89-071a6c4ad65f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:57.846247 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-327f6d99-aed9-4446-bf89-071a6c4ad65f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:57.846991 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-327f6d99-aed9-4446-bf89-071a6c4ad65f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:57.847446 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-327f6d99-aed9-4446-bf89-071a6c4ad65f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:57.847871 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-327f6d99-aed9-4446-bf89-071a6c4ad65f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:57.871192 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-327f6d99-aed9-4446-bf89-071a6c4ad65f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16/ips" status: 200 len: 151 microversion: 2.1 time: 0.037702 Sep 20 04:56:57.871756 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 318/468] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Sep 20 04:56:57 2022] GET /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 04:56:59.219535 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-e1ef19e8-b93f-4e85-8380-b76907cd94e9 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b5bd9edc-cdbd-485e-b538-457529c7337f"}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:56:59.221930 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-e1ef19e8-b93f-4e85-8380-b76907cd94e9 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 08dd20c3-27f2-4e1a-b083-c17cb2171a16] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:56:59.224357 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:56:59.230213 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e1ef19e8-b93f-4e85-8380-b76907cd94e9 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:59.230690 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e1ef19e8-b93f-4e85-8380-b76907cd94e9 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:59.231120 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e1ef19e8-b93f-4e85-8380-b76907cd94e9 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:59.231801 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e1ef19e8-b93f-4e85-8380-b76907cd94e9 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:56:59.232249 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e1ef19e8-b93f-4e85-8380-b76907cd94e9 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:56:59.232771 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e1ef19e8-b93f-4e85-8380-b76907cd94e9 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:56:59.720176 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-e1ef19e8-b93f-4e85-8380-b76907cd94e9 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "POST /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.504450 Sep 20 04:56:59.720866 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 319/469] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Sep 20 04:56:59 2022] POST /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16/os-volume_attachments => generated 194 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 04:57:07.344025 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-fb87624c-0f74-4d4a-9a8a-aea0a01b0b4e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b5bd9edc-cdbd-485e-b538-457529c7337f"}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:57:07.346593 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-fb87624c-0f74-4d4a-9a8a-aea0a01b0b4e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 08dd20c3-27f2-4e1a-b083-c17cb2171a16] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:07.352926 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fb87624c-0f74-4d4a-9a8a-aea0a01b0b4e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:07.353400 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fb87624c-0f74-4d4a-9a8a-aea0a01b0b4e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:07.353831 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fb87624c-0f74-4d4a-9a8a-aea0a01b0b4e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:07.355009 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fb87624c-0f74-4d4a-9a8a-aea0a01b0b4e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:07.355451 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fb87624c-0f74-4d4a-9a8a-aea0a01b0b4e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:07.355868 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fb87624c-0f74-4d4a-9a8a-aea0a01b0b4e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:07.435497 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.wsgi [None req-fb87624c-0f74-4d4a-9a8a-aea0a01b0b4e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] HTTP exception thrown: Invalid volume: volume b5bd9edc-cdbd-485e-b538-457529c7337f is already attached to instances: 08dd20c3-27f2-4e1a-b083-c17cb2171a16 Sep 20 04:57:07.437233 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-fb87624c-0f74-4d4a-9a8a-aea0a01b0b4e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Request method failure captured: Sep 20 04:57:07.437233 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: request: POST /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16/os-volume_attachments HTTP/1.1 Sep 20 04:57:07.437233 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept: application/json Sep 20 04:57:07.437233 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept-Encoding: identity Sep 20 04:57:07.437233 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Connection: close Sep 20 04:57:07.437233 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Length: 74 Sep 20 04:57:07.437233 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Type: application/json Sep 20 04:57:07.437233 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Host: 10.222.0.27 Sep 20 04:57:07.437233 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Openstack-System-Scope: None Sep 20 04:57:07.437233 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: User-Agent: python-urllib3/1.26.12 Sep 20 04:57:07.437233 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Auth-Token: gAAAAABjKUbv3hCswc9OTl1x4i1QFI6XV3GUT2FYN7UTgjG9dzuM3jqx_GcwO4w0JWwRz9sTS2WwajnGfx2wJ2_1hAz4UUEc_snPtCtdpEIJJc5Fb8lrnltNsG7f_iYNiB6Uy9F1dOvGdMIHwFbxpPMJ6tdvqkqh2eaYhvMGxVgemwP0gnqQm2U Sep 20 04:57:07.437233 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Id: None Sep 20 04:57:07.437233 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Name: None Sep 20 04:57:07.437233 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Identity-Status: Confirmed Sep 20 04:57:07.437233 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Is-Admin-Project: True Sep 20 04:57:07.437233 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Id: default Sep 20 04:57:07.437233 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Name: Default Sep 20 04:57:07.437233 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Id: 4f0f0b8842ae496292c27a6ee1350d32 Sep 20 04:57:07.437233 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Name: tempest-AttachVolumeNegativeTest-1482924724 Sep 20 04:57:07.437233 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Role: reader,member Sep 20 04:57:07.437233 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Roles: reader,member Sep 20 04:57:07.438868 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f0f0b8842ae496292c27a6ee1350d32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f0f0b8842ae496292c27a6ee1350d32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4f0f0b8842ae496292c27a6ee1350d32", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4f0f0b8842ae496292c27a6ee1350d32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 04:57:07.438868 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant: tempest-AttachVolumeNegativeTest-1482924724 Sep 20 04:57:07.438868 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Id: 4f0f0b8842ae496292c27a6ee1350d32 Sep 20 04:57:07.438868 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1482924724 Sep 20 04:57:07.438868 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User: tempest-AttachVolumeNegativeTest-1482924724-project Sep 20 04:57:07.438868 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Id: default Sep 20 04:57:07.438868 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Name: Default Sep 20 04:57:07.438868 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Id: c93f22104a7b4a7caf0cc8b7180ffc55 Sep 20 04:57:07.438868 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Name: tempest-AttachVolumeNegativeTest-1482924724-project Sep 20 04:57:07.438868 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Sep 20 04:57:07.438868 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {"volumeAttachment": {"volumeId": "b5bd9edc-cdbd-485e-b538-457529c7337f"}} Sep 20 04:57:07.438868 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: method: > Sep 20 04:57:07.439751 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: exception: Invalid volume: volume b5bd9edc-cdbd-485e-b538-457529c7337f is already attached to instances: 08dd20c3-27f2-4e1a-b083-c17cb2171a16 Sep 20 04:57:07.439751 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: action_args: {'server_id': '08dd20c3-27f2-4e1a-b083-c17cb2171a16', 'body': {'volumeAttachment': {'volumeId': 'b5bd9edc-cdbd-485e-b538-457529c7337f'}}} Sep 20 04:57:07.439751 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 04:57:07.439751 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:57:07.439751 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 20 04:57:07.439751 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 20 04:57:07.439751 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 20 04:57:07.439751 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 20 04:57:07.439751 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 20 04:57:07.439751 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 20 04:57:07.439751 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 20 04:57:07.439751 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 20 04:57:07.439751 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 20 04:57:07.439751 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 20 04:57:07.439751 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b5bd9edc-cdbd-485e-b538-457529c7337f is already attached to instances: 08dd20c3-27f2-4e1a-b083-c17cb2171a16 Sep 20 04:57:07.439751 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:57:07.439751 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:57:07.439751 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:57:07.439751 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:57:07.441232 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:57:07.441232 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:57:07.441232 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 04:57:07.441232 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 04:57:07.441232 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 04:57:07.441232 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 04:57:07.441232 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 20 04:57:07.441232 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 20 04:57:07.441232 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 20 04:57:07.441232 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 20 04:57:07.441232 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 20 04:57:07.441232 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 20 04:57:07.441232 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 20 04:57:07.441232 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 20 04:57:07.441232 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b5bd9edc-cdbd-485e-b538-457529c7337f is already attached to instances: 08dd20c3-27f2-4e1a-b083-c17cb2171a16 Sep 20 04:57:07.441232 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:57:07.441232 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:57:07.441232 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:57:07.441232 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:57:07.441232 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:57:07.442821 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:57:07.442821 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 04:57:07.442821 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 04:57:07.442821 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b5bd9edc-cdbd-485e-b538-457529c7337f is already attached to instances: 08dd20c3-27f2-4e1a-b083-c17cb2171a16 Sep 20 04:57:07.442821 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:57:07.442821 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-fb87624c-0f74-4d4a-9a8a-aea0a01b0b4e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Returning 400 to user: Invalid volume: volume b5bd9edc-cdbd-485e-b538-457529c7337f is already attached to instances: 08dd20c3-27f2-4e1a-b083-c17cb2171a16 {{(pid=126813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 04:57:07.442821 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-fb87624c-0f74-4d4a-9a8a-aea0a01b0b4e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "POST /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099776 Sep 20 04:57:07.442821 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 320/470] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Sep 20 04:57:07 2022] POST /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 20 04:57:07.502749 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-533e5eb7-8583-430a-9a16-b44ab9701101 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:07.503242 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-533e5eb7-8583-430a-9a16-b44ab9701101 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 08dd20c3-27f2-4e1a-b083-c17cb2171a16] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:07.509524 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-533e5eb7-8583-430a-9a16-b44ab9701101 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:07.509996 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-533e5eb7-8583-430a-9a16-b44ab9701101 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:07.510421 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-533e5eb7-8583-430a-9a16-b44ab9701101 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:07.511093 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-533e5eb7-8583-430a-9a16-b44ab9701101 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:07.511535 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-533e5eb7-8583-430a-9a16-b44ab9701101 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:07.511949 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-533e5eb7-8583-430a-9a16-b44ab9701101 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:07.590787 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.objects.instance [None req-533e5eb7-8583-430a-9a16-b44ab9701101 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lazy-loading 'services' on Instance uuid 08dd20c3-27f2-4e1a-b083-c17cb2171a16 {{(pid=126813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 04:57:07.662752 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-533e5eb7-8583-430a-9a16-b44ab9701101 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "DELETE /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16/os-volume_attachments/b5bd9edc-cdbd-485e-b538-457529c7337f" status: 202 len: 0 microversion: 2.1 time: 0.163542 Sep 20 04:57:07.663295 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 321/471] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Sep 20 04:57:07 2022] DELETE /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16/os-volume_attachments/b5bd9edc-cdbd-485e-b538-457529c7337f => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 20 04:57:07.672742 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-90cded92-53fc-4534-9d68-b00cc21d12c4 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:07.674993 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-90cded92-53fc-4534-9d68-b00cc21d12c4 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 08dd20c3-27f2-4e1a-b083-c17cb2171a16] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:07.681909 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-90cded92-53fc-4534-9d68-b00cc21d12c4 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:07.682439 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-90cded92-53fc-4534-9d68-b00cc21d12c4 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:07.682905 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-90cded92-53fc-4534-9d68-b00cc21d12c4 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:07.683603 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-90cded92-53fc-4534-9d68-b00cc21d12c4 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:07.684066 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-90cded92-53fc-4534-9d68-b00cc21d12c4 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:07.684582 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-90cded92-53fc-4534-9d68-b00cc21d12c4 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:07.714895 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-90cded92-53fc-4534-9d68-b00cc21d12c4 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046344 Sep 20 04:57:07.715463 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 322/472] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Sep 20 04:57:07 2022] GET /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 04:57:08.728465 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-69b1047a-72e5-4cdb-8fa9-bfa0b095906b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:08.731175 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-69b1047a-72e5-4cdb-8fa9-bfa0b095906b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 08dd20c3-27f2-4e1a-b083-c17cb2171a16] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:08.737745 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-69b1047a-72e5-4cdb-8fa9-bfa0b095906b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:08.738227 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-69b1047a-72e5-4cdb-8fa9-bfa0b095906b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:08.738665 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-69b1047a-72e5-4cdb-8fa9-bfa0b095906b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:08.739350 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-69b1047a-72e5-4cdb-8fa9-bfa0b095906b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:08.739803 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-69b1047a-72e5-4cdb-8fa9-bfa0b095906b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:08.740228 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-69b1047a-72e5-4cdb-8fa9-bfa0b095906b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:08.769818 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-69b1047a-72e5-4cdb-8fa9-bfa0b095906b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045275 Sep 20 04:57:08.770610 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 323/473] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Sep 20 04:57:08 2022] GET /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 20 04:57:08.834083 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-f3d682f1-017f-4d63-9cbf-467fae7fd0d0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:08.834517 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-f3d682f1-017f-4d63-9cbf-467fae7fd0d0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 08dd20c3-27f2-4e1a-b083-c17cb2171a16] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:08.840412 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f3d682f1-017f-4d63-9cbf-467fae7fd0d0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:08.840923 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f3d682f1-017f-4d63-9cbf-467fae7fd0d0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:08.841366 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f3d682f1-017f-4d63-9cbf-467fae7fd0d0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:08.842045 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f3d682f1-017f-4d63-9cbf-467fae7fd0d0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:08.842499 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f3d682f1-017f-4d63-9cbf-467fae7fd0d0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:08.842923 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f3d682f1-017f-4d63-9cbf-467fae7fd0d0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:08.867541 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-f3d682f1-017f-4d63-9cbf-467fae7fd0d0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 08dd20c3-27f2-4e1a-b083-c17cb2171a16] Going to try to terminate instance {{(pid=126813) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 20 04:57:08.911680 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:57:08.944339 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-f3d682f1-017f-4d63-9cbf-467fae7fd0d0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "DELETE /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16" status: 204 len: 0 microversion: 2.1 time: 0.113876 Sep 20 04:57:08.945108 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 324/474] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Sep 20 04:57:08 2022] DELETE /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 20 04:57:08.953845 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-637dc129-95ce-44b6-a227-d157639b35e3 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:08.954622 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-637dc129-95ce-44b6-a227-d157639b35e3 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 08dd20c3-27f2-4e1a-b083-c17cb2171a16] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:08.960419 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-637dc129-95ce-44b6-a227-d157639b35e3 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:08.960940 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-637dc129-95ce-44b6-a227-d157639b35e3 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:08.961378 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-637dc129-95ce-44b6-a227-d157639b35e3 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:08.962062 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-637dc129-95ce-44b6-a227-d157639b35e3 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:08.962520 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-637dc129-95ce-44b6-a227-d157639b35e3 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:08.962937 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-637dc129-95ce-44b6-a227-d157639b35e3 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:09.091011 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-637dc129-95ce-44b6-a227-d157639b35e3 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:09.098655 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-637dc129-95ce-44b6-a227-d157639b35e3 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16" status: 200 len: 1680 microversion: 2.1 time: 0.148980 Sep 20 04:57:09.099218 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 325/475] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:57:08 2022] GET /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16 => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:57:09.282611 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-37a657ec-5633-4186-8ef1-fb6d69d6544d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:09.283131 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-37a657ec-5633-4186-8ef1-fb6d69d6544d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:09.289561 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-37a657ec-5633-4186-8ef1-fb6d69d6544d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:09.290040 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-37a657ec-5633-4186-8ef1-fb6d69d6544d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:09.290476 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-37a657ec-5633-4186-8ef1-fb6d69d6544d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:09.291158 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-37a657ec-5633-4186-8ef1-fb6d69d6544d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:09.291609 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-37a657ec-5633-4186-8ef1-fb6d69d6544d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:09.292058 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-37a657ec-5633-4186-8ef1-fb6d69d6544d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:09.371526 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.objects.instance [None req-37a657ec-5633-4186-8ef1-fb6d69d6544d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lazy-loading 'services' on Instance uuid 8df00208-8207-4ff8-9979-2e00926de906 {{(pid=126813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 04:57:09.442006 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-37a657ec-5633-4186-8ef1-fb6d69d6544d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906/os-volume_attachments/f6b33c1f-e645-4e15-9aec-ec8a988a485d" status: 202 len: 0 microversion: 2.1 time: 0.163049 Sep 20 04:57:09.442589 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 326/476] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Sep 20 04:57:09 2022] DELETE /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906/os-volume_attachments/f6b33c1f-e645-4e15-9aec-ec8a988a485d => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 20 04:57:09.450936 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-2cb090b8-3daf-47df-9ada-cf3d6be0b513 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:09.453258 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-2cb090b8-3daf-47df-9ada-cf3d6be0b513 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:09.459187 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2cb090b8-3daf-47df-9ada-cf3d6be0b513 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:09.459656 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2cb090b8-3daf-47df-9ada-cf3d6be0b513 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:09.460100 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2cb090b8-3daf-47df-9ada-cf3d6be0b513 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:09.460794 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2cb090b8-3daf-47df-9ada-cf3d6be0b513 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:09.461245 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2cb090b8-3daf-47df-9ada-cf3d6be0b513 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:09.461661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2cb090b8-3daf-47df-9ada-cf3d6be0b513 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:09.490449 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-2cb090b8-3daf-47df-9ada-cf3d6be0b513 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043529 Sep 20 04:57:09.490976 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 327/477] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Sep 20 04:57:09 2022] GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 04:57:10.122071 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-52e54be1-f336-4f7a-b192-fda9c95b9e22 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:10.122632 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-52e54be1-f336-4f7a-b192-fda9c95b9e22 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 08dd20c3-27f2-4e1a-b083-c17cb2171a16] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:10.128525 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-52e54be1-f336-4f7a-b192-fda9c95b9e22 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:10.129032 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-52e54be1-f336-4f7a-b192-fda9c95b9e22 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:10.129463 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-52e54be1-f336-4f7a-b192-fda9c95b9e22 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:10.130135 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-52e54be1-f336-4f7a-b192-fda9c95b9e22 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:10.130579 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-52e54be1-f336-4f7a-b192-fda9c95b9e22 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:10.131003 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-52e54be1-f336-4f7a-b192-fda9c95b9e22 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:10.261274 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-52e54be1-f336-4f7a-b192-fda9c95b9e22 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:10.269221 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-52e54be1-f336-4f7a-b192-fda9c95b9e22 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16" status: 200 len: 1680 microversion: 2.1 time: 0.151107 Sep 20 04:57:10.269780 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 328/478] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:57:10 2022] GET /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:57:10.503446 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-07f73780-fb2c-4e5d-8a02-be18bf5f1043 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:10.505727 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-07f73780-fb2c-4e5d-8a02-be18bf5f1043 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:10.512648 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-07f73780-fb2c-4e5d-8a02-be18bf5f1043 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:10.513130 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-07f73780-fb2c-4e5d-8a02-be18bf5f1043 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:10.513564 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-07f73780-fb2c-4e5d-8a02-be18bf5f1043 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:10.514245 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-07f73780-fb2c-4e5d-8a02-be18bf5f1043 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:10.514694 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-07f73780-fb2c-4e5d-8a02-be18bf5f1043 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:10.515122 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-07f73780-fb2c-4e5d-8a02-be18bf5f1043 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:10.546730 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-07f73780-fb2c-4e5d-8a02-be18bf5f1043 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047244 Sep 20 04:57:10.547296 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 329/479] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Sep 20 04:57:10 2022] GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 04:57:11.293943 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-66505aeb-67a5-425b-afba-ff39ff94e8cc tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:11.294627 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-66505aeb-67a5-425b-afba-ff39ff94e8cc tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 08dd20c3-27f2-4e1a-b083-c17cb2171a16] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:11.301206 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-66505aeb-67a5-425b-afba-ff39ff94e8cc tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:11.301684 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-66505aeb-67a5-425b-afba-ff39ff94e8cc tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:11.302116 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-66505aeb-67a5-425b-afba-ff39ff94e8cc tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:11.302810 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-66505aeb-67a5-425b-afba-ff39ff94e8cc tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:11.303260 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-66505aeb-67a5-425b-afba-ff39ff94e8cc tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:11.303676 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-66505aeb-67a5-425b-afba-ff39ff94e8cc tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:11.505590 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-66505aeb-67a5-425b-afba-ff39ff94e8cc tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:11.514817 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-66505aeb-67a5-425b-afba-ff39ff94e8cc tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16" status: 200 len: 1680 microversion: 2.1 time: 0.225439 Sep 20 04:57:11.515602 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 330/480] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:57:11 2022] GET /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16 => generated 1680 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:57:11.558665 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-8c4b395f-4d22-4836-bd4a-f66c4111fd9d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:11.562228 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-8c4b395f-4d22-4836-bd4a-f66c4111fd9d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:11.569986 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8c4b395f-4d22-4836-bd4a-f66c4111fd9d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:11.570469 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8c4b395f-4d22-4836-bd4a-f66c4111fd9d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:11.570903 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8c4b395f-4d22-4836-bd4a-f66c4111fd9d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:11.571589 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8c4b395f-4d22-4836-bd4a-f66c4111fd9d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:11.572038 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8c4b395f-4d22-4836-bd4a-f66c4111fd9d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:11.572460 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8c4b395f-4d22-4836-bd4a-f66c4111fd9d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:11.603684 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-8c4b395f-4d22-4836-bd4a-f66c4111fd9d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049016 Sep 20 04:57:11.604262 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 331/481] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Sep 20 04:57:11 2022] GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:57:12.323984 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-ef0347f5-6164-4a21-a9bd-3d4903f69647 req-fce702e7-a042-4456-a917-aa8b9e1cb3a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08dd20c3-27f2-4e1a-b083-c17cb2171a16", "name": "network-vif-deleted", "tag": "9dbcee22-d7bf-4a73-ad7d-7dfafedd14d0"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:57:12.335842 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-ef0347f5-6164-4a21-a9bd-3d4903f69647 req-fce702e7-a042-4456-a917-aa8b9e1cb3a8 service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:12.336318 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-ef0347f5-6164-4a21-a9bd-3d4903f69647 req-fce702e7-a042-4456-a917-aa8b9e1cb3a8 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:12.336797 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-ef0347f5-6164-4a21-a9bd-3d4903f69647 req-fce702e7-a042-4456-a917-aa8b9e1cb3a8 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:12.352063 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-ef0347f5-6164-4a21-a9bd-3d4903f69647 req-fce702e7-a042-4456-a917-aa8b9e1cb3a8 service nova] Creating event network-vif-deleted:9dbcee22-d7bf-4a73-ad7d-7dfafedd14d0 for instance 08dd20c3-27f2-4e1a-b083-c17cb2171a16 on hv-cinder-75671 Sep 20 04:57:12.359338 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-ef0347f5-6164-4a21-a9bd-3d4903f69647 req-fce702e7-a042-4456-a917-aa8b9e1cb3a8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039063 Sep 20 04:57:12.359947 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 332/482] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 04:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 04:57:12.543481 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-a44428a2-4f52-4b00-9de1-25244c5c1914 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:12.544332 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-a44428a2-4f52-4b00-9de1-25244c5c1914 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 08dd20c3-27f2-4e1a-b083-c17cb2171a16] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:12.552038 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a44428a2-4f52-4b00-9de1-25244c5c1914 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:12.552526 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a44428a2-4f52-4b00-9de1-25244c5c1914 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:12.553026 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a44428a2-4f52-4b00-9de1-25244c5c1914 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:12.553745 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a44428a2-4f52-4b00-9de1-25244c5c1914 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:12.554197 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a44428a2-4f52-4b00-9de1-25244c5c1914 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:12.554670 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a44428a2-4f52-4b00-9de1-25244c5c1914 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:12.590073 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a44428a2-4f52-4b00-9de1-25244c5c1914 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:12.590549 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a44428a2-4f52-4b00-9de1-25244c5c1914 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:12.590984 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a44428a2-4f52-4b00-9de1-25244c5c1914 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:12.591420 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.objects.instance [None req-a44428a2-4f52-4b00-9de1-25244c5c1914 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lazy-loading 'fault' on Instance uuid 08dd20c3-27f2-4e1a-b083-c17cb2171a16 {{(pid=126813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 04:57:12.634513 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-a44428a2-4f52-4b00-9de1-25244c5c1914 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:12.643317 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-a44428a2-4f52-4b00-9de1-25244c5c1914 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16" status: 200 len: 1330 microversion: 2.1 time: 0.104871 Sep 20 04:57:12.643913 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 333/483] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:57:12 2022] GET /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16 => generated 1330 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:57:12.648647 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-b009c5e6-415e-484e-90e4-6049c7d856f3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:12.650922 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-b009c5e6-415e-484e-90e4-6049c7d856f3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:12.658491 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b009c5e6-415e-484e-90e4-6049c7d856f3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:12.659279 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b009c5e6-415e-484e-90e4-6049c7d856f3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:12.659840 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b009c5e6-415e-484e-90e4-6049c7d856f3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:12.660639 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b009c5e6-415e-484e-90e4-6049c7d856f3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:12.661131 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b009c5e6-415e-484e-90e4-6049c7d856f3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:12.661566 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b009c5e6-415e-484e-90e4-6049c7d856f3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:12.692855 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-b009c5e6-415e-484e-90e4-6049c7d856f3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047863 Sep 20 04:57:12.693589 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 334/484] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Sep 20 04:57:12 2022] GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 20 04:57:12.769249 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-bba42bab-59c4-432e-99fc-780ffc7f8491 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:12.770681 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-bba42bab-59c4-432e-99fc-780ffc7f8491 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:12.778110 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-bba42bab-59c4-432e-99fc-780ffc7f8491 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:12.778953 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-bba42bab-59c4-432e-99fc-780ffc7f8491 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:12.779655 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-bba42bab-59c4-432e-99fc-780ffc7f8491 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:12.780785 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-bba42bab-59c4-432e-99fc-780ffc7f8491 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:12.781510 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-bba42bab-59c4-432e-99fc-780ffc7f8491 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:12.782186 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-bba42bab-59c4-432e-99fc-780ffc7f8491 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:12.808531 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-bba42bab-59c4-432e-99fc-780ffc7f8491 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Going to try to terminate instance {{(pid=126813) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 20 04:57:12.887762 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-bba42bab-59c4-432e-99fc-780ffc7f8491 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906" status: 204 len: 0 microversion: 2.1 time: 0.122279 Sep 20 04:57:12.888428 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 335/485] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Sep 20 04:57:12 2022] DELETE /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 20 04:57:12.897077 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-8a66adff-1ac5-45a0-bd0c-c15ee6a4c169 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:12.897816 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-8a66adff-1ac5-45a0-bd0c-c15ee6a4c169 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:12.904233 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8a66adff-1ac5-45a0-bd0c-c15ee6a4c169 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:12.904744 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8a66adff-1ac5-45a0-bd0c-c15ee6a4c169 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:12.905184 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8a66adff-1ac5-45a0-bd0c-c15ee6a4c169 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:12.905873 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8a66adff-1ac5-45a0-bd0c-c15ee6a4c169 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:12.906331 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8a66adff-1ac5-45a0-bd0c-c15ee6a4c169 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:12.906824 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8a66adff-1ac5-45a0-bd0c-c15ee6a4c169 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:13.043782 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-8a66adff-1ac5-45a0-bd0c-c15ee6a4c169 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:13.051932 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-8a66adff-1ac5-45a0-bd0c-c15ee6a4c169 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906" status: 200 len: 1690 microversion: 2.1 time: 0.158831 Sep 20 04:57:13.052517 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 336/486] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:57:12 2022] GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906 => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:57:13.667451 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-e7ee83ba-02b5-4a44-9a2d-734054496a5c tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:13.668114 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-e7ee83ba-02b5-4a44-9a2d-734054496a5c tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 08dd20c3-27f2-4e1a-b083-c17cb2171a16] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:13.674473 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e7ee83ba-02b5-4a44-9a2d-734054496a5c tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:13.674950 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e7ee83ba-02b5-4a44-9a2d-734054496a5c tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:13.675379 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e7ee83ba-02b5-4a44-9a2d-734054496a5c tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:13.676053 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e7ee83ba-02b5-4a44-9a2d-734054496a5c tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:13.676497 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e7ee83ba-02b5-4a44-9a2d-734054496a5c tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:13.676949 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e7ee83ba-02b5-4a44-9a2d-734054496a5c tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:13.709250 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e7ee83ba-02b5-4a44-9a2d-734054496a5c tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:13.709725 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e7ee83ba-02b5-4a44-9a2d-734054496a5c tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:13.710155 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e7ee83ba-02b5-4a44-9a2d-734054496a5c tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:13.710602 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.objects.instance [None req-e7ee83ba-02b5-4a44-9a2d-734054496a5c tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lazy-loading 'fault' on Instance uuid 08dd20c3-27f2-4e1a-b083-c17cb2171a16 {{(pid=126813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 04:57:13.752768 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-e7ee83ba-02b5-4a44-9a2d-734054496a5c tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:13.760645 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-e7ee83ba-02b5-4a44-9a2d-734054496a5c tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16" status: 200 len: 1330 microversion: 2.1 time: 0.097514 Sep 20 04:57:13.761219 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 337/487] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:57:13 2022] GET /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16 => generated 1330 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:57:14.078572 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-94b0860b-f3c3-44ce-b961-9cf44c6b203f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:14.079175 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-94b0860b-f3c3-44ce-b961-9cf44c6b203f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:14.085107 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-94b0860b-f3c3-44ce-b961-9cf44c6b203f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:14.085582 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-94b0860b-f3c3-44ce-b961-9cf44c6b203f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:14.086009 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-94b0860b-f3c3-44ce-b961-9cf44c6b203f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:14.086683 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-94b0860b-f3c3-44ce-b961-9cf44c6b203f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:14.087163 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-94b0860b-f3c3-44ce-b961-9cf44c6b203f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:14.087581 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-94b0860b-f3c3-44ce-b961-9cf44c6b203f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:14.225309 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-94b0860b-f3c3-44ce-b961-9cf44c6b203f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:14.228823 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:57:14.233867 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-94b0860b-f3c3-44ce-b961-9cf44c6b203f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906" status: 200 len: 1690 microversion: 2.1 time: 0.159148 Sep 20 04:57:14.234437 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 338/488] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:57:14 2022] GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906 => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:57:14.785318 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-3de9ca75-4e04-4765-acc0-b2513ba43274 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:14.785989 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-3de9ca75-4e04-4765-acc0-b2513ba43274 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 08dd20c3-27f2-4e1a-b083-c17cb2171a16] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:14.793396 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3de9ca75-4e04-4765-acc0-b2513ba43274 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:14.793871 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3de9ca75-4e04-4765-acc0-b2513ba43274 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:14.794300 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3de9ca75-4e04-4765-acc0-b2513ba43274 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:14.794974 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3de9ca75-4e04-4765-acc0-b2513ba43274 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:14.795418 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3de9ca75-4e04-4765-acc0-b2513ba43274 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:14.795835 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3de9ca75-4e04-4765-acc0-b2513ba43274 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:14.829053 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3de9ca75-4e04-4765-acc0-b2513ba43274 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:14.829536 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3de9ca75-4e04-4765-acc0-b2513ba43274 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:14.829968 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3de9ca75-4e04-4765-acc0-b2513ba43274 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:14.830411 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.objects.instance [None req-3de9ca75-4e04-4765-acc0-b2513ba43274 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lazy-loading 'fault' on Instance uuid 08dd20c3-27f2-4e1a-b083-c17cb2171a16 {{(pid=126813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 04:57:14.873437 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-3de9ca75-4e04-4765-acc0-b2513ba43274 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:14.881102 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-3de9ca75-4e04-4765-acc0-b2513ba43274 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16" status: 200 len: 1330 microversion: 2.1 time: 0.100257 Sep 20 04:57:14.881667 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 339/489] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:57:14 2022] GET /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16 => generated 1330 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:57:15.256732 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-6234afcc-6763-4d0a-80da-80f967065152 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:15.257340 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-6234afcc-6763-4d0a-80da-80f967065152 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:15.263329 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6234afcc-6763-4d0a-80da-80f967065152 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:15.263804 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6234afcc-6763-4d0a-80da-80f967065152 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:15.264235 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6234afcc-6763-4d0a-80da-80f967065152 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:15.264937 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6234afcc-6763-4d0a-80da-80f967065152 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:15.265381 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6234afcc-6763-4d0a-80da-80f967065152 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:15.265798 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6234afcc-6763-4d0a-80da-80f967065152 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:15.391838 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-6234afcc-6763-4d0a-80da-80f967065152 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:15.399458 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-6234afcc-6763-4d0a-80da-80f967065152 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906" status: 200 len: 1690 microversion: 2.1 time: 0.146646 Sep 20 04:57:15.400014 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 340/490] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:57:15 2022] GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906 => generated 1690 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:57:15.904231 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-f8b58d29-f110-4094-ae6a-e6188d65091f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:15.904911 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-f8b58d29-f110-4094-ae6a-e6188d65091f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 08dd20c3-27f2-4e1a-b083-c17cb2171a16] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:15.911342 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f8b58d29-f110-4094-ae6a-e6188d65091f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:15.911828 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f8b58d29-f110-4094-ae6a-e6188d65091f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:15.912264 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f8b58d29-f110-4094-ae6a-e6188d65091f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:15.912978 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f8b58d29-f110-4094-ae6a-e6188d65091f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:15.913437 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f8b58d29-f110-4094-ae6a-e6188d65091f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:15.913865 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f8b58d29-f110-4094-ae6a-e6188d65091f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:15.944398 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f8b58d29-f110-4094-ae6a-e6188d65091f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:15.944918 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f8b58d29-f110-4094-ae6a-e6188d65091f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:15.945360 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f8b58d29-f110-4094-ae6a-e6188d65091f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:15.945810 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.objects.instance [None req-f8b58d29-f110-4094-ae6a-e6188d65091f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lazy-loading 'fault' on Instance uuid 08dd20c3-27f2-4e1a-b083-c17cb2171a16 {{(pid=126813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 04:57:15.984866 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-f8b58d29-f110-4094-ae6a-e6188d65091f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:15.992468 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-f8b58d29-f110-4094-ae6a-e6188d65091f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16" status: 200 len: 1330 microversion: 2.1 time: 0.092057 Sep 20 04:57:15.993057 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 341/491] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:57:15 2022] GET /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16 => generated 1330 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:57:16.423366 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-eecff66e-4ad7-4b1e-97e6-e12fc184a725 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:16.423921 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-eecff66e-4ad7-4b1e-97e6-e12fc184a725 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:16.429890 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-eecff66e-4ad7-4b1e-97e6-e12fc184a725 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:16.430365 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-eecff66e-4ad7-4b1e-97e6-e12fc184a725 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:16.430796 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-eecff66e-4ad7-4b1e-97e6-e12fc184a725 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:16.431468 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-eecff66e-4ad7-4b1e-97e6-e12fc184a725 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:16.431931 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-eecff66e-4ad7-4b1e-97e6-e12fc184a725 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:16.433098 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-eecff66e-4ad7-4b1e-97e6-e12fc184a725 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:16.642604 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-eecff66e-4ad7-4b1e-97e6-e12fc184a725 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:16.655156 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-eecff66e-4ad7-4b1e-97e6-e12fc184a725 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906" status: 200 len: 1690 microversion: 2.1 time: 0.235756 Sep 20 04:57:16.655929 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 342/492] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:57:16 2022] GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906 => generated 1690 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:57:17.015695 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-b9625718-e369-42c0-8fc9-69470300cff9 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:17.016797 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-b9625718-e369-42c0-8fc9-69470300cff9 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 08dd20c3-27f2-4e1a-b083-c17cb2171a16] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:17.022978 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b9625718-e369-42c0-8fc9-69470300cff9 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:17.023468 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b9625718-e369-42c0-8fc9-69470300cff9 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:17.023907 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b9625718-e369-42c0-8fc9-69470300cff9 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:17.024631 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b9625718-e369-42c0-8fc9-69470300cff9 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:17.025087 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b9625718-e369-42c0-8fc9-69470300cff9 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:17.025516 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b9625718-e369-42c0-8fc9-69470300cff9 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:17.040484 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.wsgi [None req-b9625718-e369-42c0-8fc9-69470300cff9 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] HTTP exception thrown: Instance 08dd20c3-27f2-4e1a-b083-c17cb2171a16 could not be found. Sep 20 04:57:17.042727 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-b9625718-e369-42c0-8fc9-69470300cff9 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Request method failure captured: Sep 20 04:57:17.042727 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: request: GET /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16 HTTP/1.1 Sep 20 04:57:17.042727 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept: application/json Sep 20 04:57:17.042727 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept-Encoding: identity Sep 20 04:57:17.042727 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Connection: close Sep 20 04:57:17.042727 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Length: 0 Sep 20 04:57:17.042727 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Type: application/json Sep 20 04:57:17.042727 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Host: 10.222.0.27 Sep 20 04:57:17.042727 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Openstack-System-Scope: None Sep 20 04:57:17.042727 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: User-Agent: python-urllib3/1.26.12 Sep 20 04:57:17.042727 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Auth-Token: gAAAAABjKUbv3hCswc9OTl1x4i1QFI6XV3GUT2FYN7UTgjG9dzuM3jqx_GcwO4w0JWwRz9sTS2WwajnGfx2wJ2_1hAz4UUEc_snPtCtdpEIJJc5Fb8lrnltNsG7f_iYNiB6Uy9F1dOvGdMIHwFbxpPMJ6tdvqkqh2eaYhvMGxVgemwP0gnqQm2U Sep 20 04:57:17.042727 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Id: None Sep 20 04:57:17.042727 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Name: None Sep 20 04:57:17.042727 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Identity-Status: Confirmed Sep 20 04:57:17.042727 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Is-Admin-Project: True Sep 20 04:57:17.042727 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Id: default Sep 20 04:57:17.042727 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Name: Default Sep 20 04:57:17.042727 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Id: 4f0f0b8842ae496292c27a6ee1350d32 Sep 20 04:57:17.042727 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Name: tempest-AttachVolumeNegativeTest-1482924724 Sep 20 04:57:17.042727 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Role: reader,member Sep 20 04:57:17.042727 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Roles: reader,member Sep 20 04:57:17.044142 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f0f0b8842ae496292c27a6ee1350d32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f0f0b8842ae496292c27a6ee1350d32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4f0f0b8842ae496292c27a6ee1350d32", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4f0f0b8842ae496292c27a6ee1350d32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 04:57:17.044142 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant: tempest-AttachVolumeNegativeTest-1482924724 Sep 20 04:57:17.044142 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Id: 4f0f0b8842ae496292c27a6ee1350d32 Sep 20 04:57:17.044142 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1482924724 Sep 20 04:57:17.044142 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User: tempest-AttachVolumeNegativeTest-1482924724-project Sep 20 04:57:17.044142 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Id: default Sep 20 04:57:17.044142 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Name: Default Sep 20 04:57:17.044142 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Id: c93f22104a7b4a7caf0cc8b7180ffc55 Sep 20 04:57:17.044142 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Name: tempest-AttachVolumeNegativeTest-1482924724-project Sep 20 04:57:17.044142 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: method: > Sep 20 04:57:17.044142 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: exception: Instance 08dd20c3-27f2-4e1a-b083-c17cb2171a16 could not be found. Sep 20 04:57:17.044142 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: action_args: {'id': '08dd20c3-27f2-4e1a-b083-c17cb2171a16'} Sep 20 04:57:17.044958 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 04:57:17.044958 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:57:17.044958 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 04:57:17.044958 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 04:57:17.044958 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 04:57:17.044958 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 04:57:17.044958 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 04:57:17.044958 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 04:57:17.044958 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 04:57:17.044958 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 04:57:17.044958 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08dd20c3-27f2-4e1a-b083-c17cb2171a16 could not be found. Sep 20 04:57:17.044958 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:57:17.044958 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:57:17.044958 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:57:17.044958 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:57:17.044958 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:57:17.044958 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:57:17.044958 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 04:57:17.044958 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 04:57:17.044958 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 04:57:17.046133 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 04:57:17.046133 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 04:57:17.046133 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 04:57:17.046133 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 04:57:17.046133 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 04:57:17.046133 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 04:57:17.046133 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 04:57:17.046133 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08dd20c3-27f2-4e1a-b083-c17cb2171a16 could not be found. Sep 20 04:57:17.046133 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:57:17.046133 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:57:17.046133 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:57:17.046133 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:57:17.046133 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:57:17.046133 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:57:17.046133 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 04:57:17.046133 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 04:57:17.046133 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08dd20c3-27f2-4e1a-b083-c17cb2171a16 could not be found. Sep 20 04:57:17.046133 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:57:17.048475 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-b9625718-e369-42c0-8fc9-69470300cff9 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Returning 404 to user: Instance 08dd20c3-27f2-4e1a-b083-c17cb2171a16 could not be found. {{(pid=126813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 04:57:17.048475 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-b9625718-e369-42c0-8fc9-69470300cff9 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16" status: 404 len: 111 microversion: 2.1 time: 0.032555 Sep 20 04:57:17.048475 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 343/493] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:57:17 2022] GET /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 20 04:57:17.053881 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-c47e619a-7b7d-45c4-abef-2770a0eb988f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '.version_select at 0x7f2e4a66edc0>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:17.075723 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-c47e619a-7b7d-45c4-abef-2770a0eb988f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-126007507" status: 202 len: 0 microversion: 2.1 time: 0.026200 Sep 20 04:57:17.076581 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 344/494] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Sep 20 04:57:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-126007507 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 20 04:57:17.579984 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-d8e6f00c-43a8-4724-af27-be367c981425 req-bdce2e97-e078-443e-b723-eb4ef3a6c5e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8df00208-8207-4ff8-9979-2e00926de906", "name": "network-vif-deleted", "tag": "0d0b44d0-2172-48f9-b9c5-88e71d3e7975"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:57:17.599754 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-d8e6f00c-43a8-4724-af27-be367c981425 req-bdce2e97-e078-443e-b723-eb4ef3a6c5e7 service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:17.600503 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-d8e6f00c-43a8-4724-af27-be367c981425 req-bdce2e97-e078-443e-b723-eb4ef3a6c5e7 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:17.602051 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-d8e6f00c-43a8-4724-af27-be367c981425 req-bdce2e97-e078-443e-b723-eb4ef3a6c5e7 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:17.623863 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-d8e6f00c-43a8-4724-af27-be367c981425 req-bdce2e97-e078-443e-b723-eb4ef3a6c5e7 service nova] Creating event network-vif-deleted:0d0b44d0-2172-48f9-b9c5-88e71d3e7975 for instance 8df00208-8207-4ff8-9979-2e00926de906 on hv-cinder-75671 Sep 20 04:57:17.630472 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-d8e6f00c-43a8-4724-af27-be367c981425 req-bdce2e97-e078-443e-b723-eb4ef3a6c5e7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159398 Sep 20 04:57:17.632341 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 345/495] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 04:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:57:17.684689 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-cf9b5084-b5c1-48c8-8ef5-7b94cd64fc82 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:17.686566 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-cf9b5084-b5c1-48c8-8ef5-7b94cd64fc82 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:17.695117 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-cf9b5084-b5c1-48c8-8ef5-7b94cd64fc82 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:17.695847 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-cf9b5084-b5c1-48c8-8ef5-7b94cd64fc82 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:17.696468 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-cf9b5084-b5c1-48c8-8ef5-7b94cd64fc82 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:17.698497 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-cf9b5084-b5c1-48c8-8ef5-7b94cd64fc82 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:17.699230 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-cf9b5084-b5c1-48c8-8ef5-7b94cd64fc82 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:17.699838 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-cf9b5084-b5c1-48c8-8ef5-7b94cd64fc82 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:17.752296 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-cf9b5084-b5c1-48c8-8ef5-7b94cd64fc82 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:17.752966 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-cf9b5084-b5c1-48c8-8ef5-7b94cd64fc82 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:17.761200 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-cf9b5084-b5c1-48c8-8ef5-7b94cd64fc82 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:17.762475 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.objects.instance [None req-cf9b5084-b5c1-48c8-8ef5-7b94cd64fc82 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lazy-loading 'fault' on Instance uuid 8df00208-8207-4ff8-9979-2e00926de906 {{(pid=126813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 04:57:17.849303 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-cf9b5084-b5c1-48c8-8ef5-7b94cd64fc82 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:17.858324 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-cf9b5084-b5c1-48c8-8ef5-7b94cd64fc82 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906" status: 200 len: 1335 microversion: 2.1 time: 0.182170 Sep 20 04:57:17.863996 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 346/496] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:57:17 2022] GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906 => generated 1335 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:57:17.910202 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-a0955f2c-50d8-416a-bf8e-7495013edbf0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Action: 'create', calling method: .version_select at 0x7f2e4a59f5e0>, body: {"keypair": {"name": "tempest-keypair-1821075672", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZfe6kOFTcZ97PwlY5xR76FoJBepA2A46sFheFBMfkhEhj09cw6oroyiRlWsdeCzfVGGj6w1nF5lIIy/tZF7YX5jmkrr95gkvTKl5oiSXDDGhJiu8QiagFL7dg3iBHILQ=="}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:57:17.926458 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-a0955f2c-50d8-416a-bf8e-7495013edbf0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Getting quotas for project 4f0f0b8842ae496292c27a6ee1350d32. Resources: {'key_pairs'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 04:57:17.930330 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-a0955f2c-50d8-416a-bf8e-7495013edbf0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Getting quotas for user c93f22104a7b4a7caf0cc8b7180ffc55 and project 4f0f0b8842ae496292c27a6ee1350d32. Resources: {'key_pairs'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 04:57:17.954197 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-a0955f2c-50d8-416a-bf8e-7495013edbf0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047910 Sep 20 04:57:17.955011 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 347/497] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Sep 20 04:57:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 04:57:18.883514 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-6533309e-b9c8-4b3a-83c1-f90d0aaac69d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:18.884142 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-6533309e-b9c8-4b3a-83c1-f90d0aaac69d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 8df00208-8207-4ff8-9979-2e00926de906] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:18.891943 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6533309e-b9c8-4b3a-83c1-f90d0aaac69d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:18.892673 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6533309e-b9c8-4b3a-83c1-f90d0aaac69d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:18.893288 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6533309e-b9c8-4b3a-83c1-f90d0aaac69d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:18.893989 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6533309e-b9c8-4b3a-83c1-f90d0aaac69d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:18.894608 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6533309e-b9c8-4b3a-83c1-f90d0aaac69d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:18.895206 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6533309e-b9c8-4b3a-83c1-f90d0aaac69d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:18.911079 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.wsgi [None req-6533309e-b9c8-4b3a-83c1-f90d0aaac69d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] HTTP exception thrown: Instance 8df00208-8207-4ff8-9979-2e00926de906 could not be found. Sep 20 04:57:18.912823 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-6533309e-b9c8-4b3a-83c1-f90d0aaac69d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Request method failure captured: Sep 20 04:57:18.912823 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: request: GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906 HTTP/1.1 Sep 20 04:57:18.912823 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept: application/json Sep 20 04:57:18.912823 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept-Encoding: identity Sep 20 04:57:18.912823 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Connection: close Sep 20 04:57:18.912823 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Length: 0 Sep 20 04:57:18.912823 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Type: application/json Sep 20 04:57:18.912823 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Host: 10.222.0.27 Sep 20 04:57:18.912823 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Openstack-System-Scope: None Sep 20 04:57:18.912823 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: User-Agent: python-urllib3/1.26.12 Sep 20 04:57:18.912823 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Auth-Token: gAAAAABjKUbuqmu710n-3SCVM36yM7K-f797gToLzqjsDE8VJysUBrvG5j-mQzogHDlEQu9N838xq1zWP21_6m2gF-Ihax1sPUYdHwZXOTHQerCv9C5MDRbeGOwZhkLdVG9uye1-Ii1JZSsdS5iGMvHtRw8Q9ofnz0LEtfTZ8xxH8stYtJrOnkg Sep 20 04:57:18.912823 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Id: None Sep 20 04:57:18.912823 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Name: None Sep 20 04:57:18.912823 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Identity-Status: Confirmed Sep 20 04:57:18.912823 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Is-Admin-Project: True Sep 20 04:57:18.912823 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Id: default Sep 20 04:57:18.912823 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Name: Default Sep 20 04:57:18.912823 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Id: 5f0a24f6f6994f45bd314d3009b0a572 Sep 20 04:57:18.912823 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-447939399 Sep 20 04:57:18.912823 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Role: reader,member Sep 20 04:57:18.912823 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Roles: reader,member Sep 20 04:57:18.914394 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5f0a24f6f6994f45bd314d3009b0a572"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5f0a24f6f6994f45bd314d3009b0a572"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5f0a24f6f6994f45bd314d3009b0a572", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5f0a24f6f6994f45bd314d3009b0a572"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 04:57:18.914394 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant: tempest-ServerRescueNegativeTestJSON-447939399 Sep 20 04:57:18.914394 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Id: 5f0a24f6f6994f45bd314d3009b0a572 Sep 20 04:57:18.914394 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-447939399 Sep 20 04:57:18.914394 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User: tempest-ServerRescueNegativeTestJSON-447939399-project Sep 20 04:57:18.914394 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Id: default Sep 20 04:57:18.914394 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Name: Default Sep 20 04:57:18.914394 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Id: 49f80b68650940e8850cbd4f84a49ef4 Sep 20 04:57:18.914394 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Name: tempest-ServerRescueNegativeTestJSON-447939399-project Sep 20 04:57:18.914394 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: method: > Sep 20 04:57:18.914394 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: exception: Instance 8df00208-8207-4ff8-9979-2e00926de906 could not be found. Sep 20 04:57:18.914394 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: action_args: {'id': '8df00208-8207-4ff8-9979-2e00926de906'} Sep 20 04:57:18.915313 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 04:57:18.915313 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:57:18.915313 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 04:57:18.915313 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 04:57:18.915313 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 04:57:18.915313 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 04:57:18.915313 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 04:57:18.915313 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 04:57:18.915313 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 04:57:18.915313 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 04:57:18.915313 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8df00208-8207-4ff8-9979-2e00926de906 could not be found. Sep 20 04:57:18.915313 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:57:18.915313 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:57:18.915313 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:57:18.915313 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:57:18.915313 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:57:18.915313 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:57:18.915313 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 04:57:18.915313 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 04:57:18.915313 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 04:57:18.916813 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 04:57:18.916813 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 04:57:18.916813 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 04:57:18.916813 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 04:57:18.916813 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 04:57:18.916813 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 04:57:18.916813 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 04:57:18.916813 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8df00208-8207-4ff8-9979-2e00926de906 could not be found. Sep 20 04:57:18.916813 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:57:18.916813 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:57:18.916813 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:57:18.916813 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:57:18.916813 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:57:18.916813 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:57:18.916813 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 04:57:18.916813 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 04:57:18.916813 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8df00208-8207-4ff8-9979-2e00926de906 could not be found. Sep 20 04:57:18.916813 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:57:18.918340 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-6533309e-b9c8-4b3a-83c1-f90d0aaac69d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Returning 404 to user: Instance 8df00208-8207-4ff8-9979-2e00926de906 could not be found. {{(pid=126813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 04:57:18.918340 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-6533309e-b9c8-4b3a-83c1-f90d0aaac69d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906" status: 404 len: 111 microversion: 2.1 time: 0.034589 Sep 20 04:57:18.918340 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 348/498] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:57:18 2022] GET /compute/v2.1/servers/8df00208-8207-4ff8-9979-2e00926de906 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 20 04:57:18.923720 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-11682098-ba37-4e1e-910e-872c836722cf tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '.version_select at 0x7f2e4a6c4820>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:18.942296 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-11682098-ba37-4e1e-910e-872c836722cf tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-879821796" status: 202 len: 0 microversion: 2.1 time: 0.022159 Sep 20 04:57:18.942863 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 349/499] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Sep 20 04:57:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-879821796 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 20 04:57:19.220180 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-9c7581d9-08e5-459b-b867-3b0c4b4a93e8 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-581928785", "imageRef": "080ea053-830e-4470-a886-0ab99b0ab3e0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "637b3136-e650-47ef-a9fe-492091eb8174"}], "security_groups": [{"name": "tempest-securitygroup--24378339"}], "key_name": "tempest-keypair-1821075672", "user_data": "}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:57:19.223903 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 20 04:57:19.224757 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: Tue Sep 20 04:57:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.27) !!! Sep 20 04:57:19.353495 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.network.neutron [None req-9c7581d9-08e5-459b-b867-3b0c4b4a93e8 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] validate_networks() for [('637b3136-e650-47ef-a9fe-492091eb8174', None, None, None, None, None)] {{(pid=126813) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 20 04:57:19.635951 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:57:19.953796 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-9c7581d9-08e5-459b-b867-3b0c4b4a93e8 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Flavor limits 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 20 04:57:19.954359 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-9c7581d9-08e5-459b-b867-3b0c4b4a93e8 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Image limits 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 20 04:57:19.954683 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-9c7581d9-08e5-459b-b867-3b0c4b4a93e8 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Flavor pref 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 20 04:57:19.955250 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-9c7581d9-08e5-459b-b867-3b0c4b4a93e8 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Image pref 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 20 04:57:19.955657 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-9c7581d9-08e5-459b-b867-3b0c4b4a93e8 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 20 04:57:19.964346 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9c7581d9-08e5-459b-b867-3b0c4b4a93e8 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:19.964852 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9c7581d9-08e5-459b-b867-3b0c4b4a93e8 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:19.965315 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9c7581d9-08e5-459b-b867-3b0c4b4a93e8 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:19.966027 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9c7581d9-08e5-459b-b867-3b0c4b4a93e8 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:19.966473 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9c7581d9-08e5-459b-b867-3b0c4b4a93e8 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:19.966890 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9c7581d9-08e5-459b-b867-3b0c4b4a93e8 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:19.983433 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-9c7581d9-08e5-459b-b867-3b0c4b4a93e8 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Getting quotas for project 4f0f0b8842ae496292c27a6ee1350d32. Resources: {'ram', 'cores', 'instances'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 04:57:19.987359 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-9c7581d9-08e5-459b-b867-3b0c4b4a93e8 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Getting quotas for user c93f22104a7b4a7caf0cc8b7180ffc55 and project 4f0f0b8842ae496292c27a6ee1350d32. Resources: {'ram', 'cores', 'instances'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 04:57:19.998761 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-9c7581d9-08e5-459b-b867-3b0c4b4a93e8 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Going to run 1 instances... {{(pid=126813) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 20 04:57:20.001144 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-9c7581d9-08e5-459b-b867-3b0c4b4a93e8 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 0f0fd5e7-f601-4fa1-870a-b2c497479260] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='080ea053-830e-4470-a886-0ab99b0ab3e0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126813) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 20 04:57:20.049361 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-9c7581d9-08e5-459b-b867-3b0c4b4a93e8 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.833545 Sep 20 04:57:20.050044 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 350/500] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Sep 20 04:57:19 2022] POST /compute/v2.1/servers => generated 400 bytes in 835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 20 04:57:20.063100 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-917fcf30-5c90-4963-af1e-e1abf9641a68 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:20.063789 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-917fcf30-5c90-4963-af1e-e1abf9641a68 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 0f0fd5e7-f601-4fa1-870a-b2c497479260] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:20.129970 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-917fcf30-5c90-4963-af1e-e1abf9641a68 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:20.139554 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-917fcf30-5c90-4963-af1e-e1abf9641a68 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/0f0fd5e7-f601-4fa1-870a-b2c497479260" status: 200 len: 1241 microversion: 2.1 time: 0.081295 Sep 20 04:57:20.140486 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 351/501] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:57:20 2022] GET /compute/v2.1/servers/0f0fd5e7-f601-4fa1-870a-b2c497479260 => generated 1241 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:57:21.163066 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-64b585ac-c73a-410d-9fed-dfb2b9a5ea04 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:21.163682 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-64b585ac-c73a-410d-9fed-dfb2b9a5ea04 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 0f0fd5e7-f601-4fa1-870a-b2c497479260] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:21.170197 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-64b585ac-c73a-410d-9fed-dfb2b9a5ea04 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:21.170675 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-64b585ac-c73a-410d-9fed-dfb2b9a5ea04 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:21.171115 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-64b585ac-c73a-410d-9fed-dfb2b9a5ea04 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:21.171803 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-64b585ac-c73a-410d-9fed-dfb2b9a5ea04 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:21.172296 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-64b585ac-c73a-410d-9fed-dfb2b9a5ea04 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:21.172750 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-64b585ac-c73a-410d-9fed-dfb2b9a5ea04 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:21.234802 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-64b585ac-c73a-410d-9fed-dfb2b9a5ea04 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:21.242912 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-64b585ac-c73a-410d-9fed-dfb2b9a5ea04 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/0f0fd5e7-f601-4fa1-870a-b2c497479260" status: 200 len: 1293 microversion: 2.1 time: 0.083623 Sep 20 04:57:21.243479 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 352/502] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:57:21 2022] GET /compute/v2.1/servers/0f0fd5e7-f601-4fa1-870a-b2c497479260 => generated 1293 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:57:22.019469 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-be7be1c0-d3f9-4765-80b5-94d8a9c6dfd6 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:22.020005 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-be7be1c0-d3f9-4765-80b5-94d8a9c6dfd6 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:22.027050 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-be7be1c0-d3f9-4765-80b5-94d8a9c6dfd6 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:22.027486 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-be7be1c0-d3f9-4765-80b5-94d8a9c6dfd6 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:22.027930 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-be7be1c0-d3f9-4765-80b5-94d8a9c6dfd6 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:22.029281 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-be7be1c0-d3f9-4765-80b5-94d8a9c6dfd6 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:22.029770 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-be7be1c0-d3f9-4765-80b5-94d8a9c6dfd6 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:22.030204 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-be7be1c0-d3f9-4765-80b5-94d8a9c6dfd6 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:22.055802 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-be7be1c0-d3f9-4765-80b5-94d8a9c6dfd6 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Going to try to terminate instance {{(pid=126813) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 20 04:57:22.134399 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-be7be1c0-d3f9-4765-80b5-94d8a9c6dfd6 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 204 len: 0 microversion: 2.1 time: 0.118637 Sep 20 04:57:22.135100 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 353/503] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Sep 20 04:57:22 2022] DELETE /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 20 04:57:22.145189 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-1a0b7bb3-4e16-4be8-bb63-96f1bc511221 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:22.145884 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-1a0b7bb3-4e16-4be8-bb63-96f1bc511221 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:22.152663 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1a0b7bb3-4e16-4be8-bb63-96f1bc511221 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:22.153199 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1a0b7bb3-4e16-4be8-bb63-96f1bc511221 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:22.154087 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1a0b7bb3-4e16-4be8-bb63-96f1bc511221 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:22.154293 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1a0b7bb3-4e16-4be8-bb63-96f1bc511221 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:22.154706 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1a0b7bb3-4e16-4be8-bb63-96f1bc511221 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:22.155123 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1a0b7bb3-4e16-4be8-bb63-96f1bc511221 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:22.587635 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-1a0b7bb3-4e16-4be8-bb63-96f1bc511221 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:22.595847 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-1a0b7bb3-4e16-4be8-bb63-96f1bc511221 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1508 microversion: 2.1 time: 0.456297 Sep 20 04:57:22.596414 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 354/504] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:57:22 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1508 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:57:22.600914 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-7f318235-fb6f-484c-99b3-52150a01c559 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:22.601465 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-7f318235-fb6f-484c-99b3-52150a01c559 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 0f0fd5e7-f601-4fa1-870a-b2c497479260] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:22.607535 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7f318235-fb6f-484c-99b3-52150a01c559 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:22.608059 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7f318235-fb6f-484c-99b3-52150a01c559 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:22.608499 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7f318235-fb6f-484c-99b3-52150a01c559 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:22.609246 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7f318235-fb6f-484c-99b3-52150a01c559 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:22.609700 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7f318235-fb6f-484c-99b3-52150a01c559 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:22.610127 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7f318235-fb6f-484c-99b3-52150a01c559 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:22.733825 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-7f318235-fb6f-484c-99b3-52150a01c559 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:22.741552 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-7f318235-fb6f-484c-99b3-52150a01c559 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/0f0fd5e7-f601-4fa1-870a-b2c497479260" status: 200 len: 1365 microversion: 2.1 time: 0.144172 Sep 20 04:57:22.742116 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 355/505] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:57:22 2022] GET /compute/v2.1/servers/0f0fd5e7-f601-4fa1-870a-b2c497479260 => generated 1365 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:57:23.620203 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-a1f43522-1890-4539-968e-e37fadad6522 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:23.620867 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-a1f43522-1890-4539-968e-e37fadad6522 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:23.627722 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a1f43522-1890-4539-968e-e37fadad6522 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:23.628271 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a1f43522-1890-4539-968e-e37fadad6522 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:23.628974 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a1f43522-1890-4539-968e-e37fadad6522 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:23.629755 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a1f43522-1890-4539-968e-e37fadad6522 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:23.630285 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a1f43522-1890-4539-968e-e37fadad6522 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:23.630779 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a1f43522-1890-4539-968e-e37fadad6522 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:23.763279 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-a1f43522-1890-4539-968e-e37fadad6522 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:23.771334 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-a1f43522-1890-4539-968e-e37fadad6522 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1508 microversion: 2.1 time: 0.155808 Sep 20 04:57:23.771900 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 356/506] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:57:23 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:57:23.778151 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-5c4579f1-dcd2-4539-ba4f-fe3a28074fcd tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:23.778930 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-5c4579f1-dcd2-4539-ba4f-fe3a28074fcd tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 0f0fd5e7-f601-4fa1-870a-b2c497479260] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:23.787951 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5c4579f1-dcd2-4539-ba4f-fe3a28074fcd tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:23.788472 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5c4579f1-dcd2-4539-ba4f-fe3a28074fcd tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:23.788932 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5c4579f1-dcd2-4539-ba4f-fe3a28074fcd tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:23.789625 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5c4579f1-dcd2-4539-ba4f-fe3a28074fcd tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:23.790077 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5c4579f1-dcd2-4539-ba4f-fe3a28074fcd tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:23.790504 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5c4579f1-dcd2-4539-ba4f-fe3a28074fcd tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:23.926649 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-5c4579f1-dcd2-4539-ba4f-fe3a28074fcd tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:23.934355 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-5c4579f1-dcd2-4539-ba4f-fe3a28074fcd tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/0f0fd5e7-f601-4fa1-870a-b2c497479260" status: 200 len: 1365 microversion: 2.1 time: 0.161376 Sep 20 04:57:23.934912 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 357/507] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:57:23 2022] GET /compute/v2.1/servers/0f0fd5e7-f601-4fa1-870a-b2c497479260 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:57:24.795266 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-24c0a147-493e-41cd-af17-bb802b3ee444 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:24.795878 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-24c0a147-493e-41cd-af17-bb802b3ee444 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:24.803506 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-24c0a147-493e-41cd-af17-bb802b3ee444 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:24.804000 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-24c0a147-493e-41cd-af17-bb802b3ee444 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:24.804427 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-24c0a147-493e-41cd-af17-bb802b3ee444 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:24.805418 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-24c0a147-493e-41cd-af17-bb802b3ee444 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:24.805870 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-24c0a147-493e-41cd-af17-bb802b3ee444 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:24.806501 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-24c0a147-493e-41cd-af17-bb802b3ee444 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:25.088870 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-24c0a147-493e-41cd-af17-bb802b3ee444 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:25.096588 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-24c0a147-493e-41cd-af17-bb802b3ee444 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 200 len: 1508 microversion: 2.1 time: 0.305805 Sep 20 04:57:25.104567 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 358/508] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:57:24 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 1508 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:57:25.109337 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-ed868d28-a450-4a16-a0d2-06167767d156 req-7cb05f0a-26e7-426e-b153-d99eccc502f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f0fd5e7-f601-4fa1-870a-b2c497479260", "tag": "7b4bd97f-fb1e-4d96-8371-721ef17b2faf"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:57:25.118822 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-ed868d28-a450-4a16-a0d2-06167767d156 req-7cb05f0a-26e7-426e-b153-d99eccc502f0 service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:25.119511 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-ed868d28-a450-4a16-a0d2-06167767d156 req-7cb05f0a-26e7-426e-b153-d99eccc502f0 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:25.119990 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-ed868d28-a450-4a16-a0d2-06167767d156 req-7cb05f0a-26e7-426e-b153-d99eccc502f0 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:25.131865 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-ed868d28-a450-4a16-a0d2-06167767d156 req-7cb05f0a-26e7-426e-b153-d99eccc502f0 service nova] Creating event network-changed:7b4bd97f-fb1e-4d96-8371-721ef17b2faf for instance 0f0fd5e7-f601-4fa1-870a-b2c497479260 on hv-cinder-75671 Sep 20 04:57:25.136851 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-ed868d28-a450-4a16-a0d2-06167767d156 req-7cb05f0a-26e7-426e-b153-d99eccc502f0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030886 Sep 20 04:57:25.137643 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 359/509] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 04:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:57:25.142653 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-02309333-7e92-4dab-9811-c6c9cc53ac1b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:25.143338 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-02309333-7e92-4dab-9811-c6c9cc53ac1b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 0f0fd5e7-f601-4fa1-870a-b2c497479260] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:25.150082 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-02309333-7e92-4dab-9811-c6c9cc53ac1b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:25.151151 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-02309333-7e92-4dab-9811-c6c9cc53ac1b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:25.151569 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-02309333-7e92-4dab-9811-c6c9cc53ac1b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:25.152258 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-02309333-7e92-4dab-9811-c6c9cc53ac1b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:25.152730 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-02309333-7e92-4dab-9811-c6c9cc53ac1b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:25.153347 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-02309333-7e92-4dab-9811-c6c9cc53ac1b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:25.157927 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:57:25.368890 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-02309333-7e92-4dab-9811-c6c9cc53ac1b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:25.377227 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-02309333-7e92-4dab-9811-c6c9cc53ac1b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/0f0fd5e7-f601-4fa1-870a-b2c497479260" status: 200 len: 1365 microversion: 2.1 time: 0.238622 Sep 20 04:57:25.377806 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 360/510] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:57:25 2022] GET /compute/v2.1/servers/0f0fd5e7-f601-4fa1-870a-b2c497479260 => generated 1365 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:57:25.442435 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-0269ea7a-9670-4e7f-93d2-aa0d094c98d4 req-cbd8224f-e7e5-4dae-8382-33eccabb5708 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4e85593-565d-40c6-bed2-121ca9466654", "name": "network-vif-deleted", "tag": "512e1b53-d964-4c70-8001-91bd16999e8b"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:57:25.451655 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-0269ea7a-9670-4e7f-93d2-aa0d094c98d4 req-cbd8224f-e7e5-4dae-8382-33eccabb5708 service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:25.452124 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-0269ea7a-9670-4e7f-93d2-aa0d094c98d4 req-cbd8224f-e7e5-4dae-8382-33eccabb5708 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:25.452548 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-0269ea7a-9670-4e7f-93d2-aa0d094c98d4 req-cbd8224f-e7e5-4dae-8382-33eccabb5708 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:25.463070 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-0269ea7a-9670-4e7f-93d2-aa0d094c98d4 req-cbd8224f-e7e5-4dae-8382-33eccabb5708 service nova] Creating event network-vif-deleted:512e1b53-d964-4c70-8001-91bd16999e8b for instance d4e85593-565d-40c6-bed2-121ca9466654 on hv-cinder-75671 Sep 20 04:57:25.467729 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-0269ea7a-9670-4e7f-93d2-aa0d094c98d4 req-cbd8224f-e7e5-4dae-8382-33eccabb5708 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088816 Sep 20 04:57:25.468281 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 361/511] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 04:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:57:26.120595 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-c356efd2-3868-411d-86c3-1c630f0b9ae2 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:26.121277 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-c356efd2-3868-411d-86c3-1c630f0b9ae2 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: d4e85593-565d-40c6-bed2-121ca9466654] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:26.127400 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c356efd2-3868-411d-86c3-1c630f0b9ae2 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:26.127878 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c356efd2-3868-411d-86c3-1c630f0b9ae2 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:26.128309 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c356efd2-3868-411d-86c3-1c630f0b9ae2 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:26.129017 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c356efd2-3868-411d-86c3-1c630f0b9ae2 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:26.129466 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c356efd2-3868-411d-86c3-1c630f0b9ae2 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:26.129886 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c356efd2-3868-411d-86c3-1c630f0b9ae2 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:26.143942 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.wsgi [None req-c356efd2-3868-411d-86c3-1c630f0b9ae2 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] HTTP exception thrown: Instance d4e85593-565d-40c6-bed2-121ca9466654 could not be found. Sep 20 04:57:26.145607 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-c356efd2-3868-411d-86c3-1c630f0b9ae2 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Request method failure captured: Sep 20 04:57:26.145607 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: request: GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 HTTP/1.1 Sep 20 04:57:26.145607 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept: application/json Sep 20 04:57:26.145607 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept-Encoding: identity Sep 20 04:57:26.145607 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Connection: close Sep 20 04:57:26.145607 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Length: 0 Sep 20 04:57:26.145607 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Type: application/json Sep 20 04:57:26.145607 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Host: 10.222.0.27 Sep 20 04:57:26.145607 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Openstack-System-Scope: None Sep 20 04:57:26.145607 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: User-Agent: python-urllib3/1.26.12 Sep 20 04:57:26.145607 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Auth-Token: gAAAAABjKUbuqmu710n-3SCVM36yM7K-f797gToLzqjsDE8VJysUBrvG5j-mQzogHDlEQu9N838xq1zWP21_6m2gF-Ihax1sPUYdHwZXOTHQerCv9C5MDRbeGOwZhkLdVG9uye1-Ii1JZSsdS5iGMvHtRw8Q9ofnz0LEtfTZ8xxH8stYtJrOnkg Sep 20 04:57:26.145607 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Id: None Sep 20 04:57:26.145607 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Name: None Sep 20 04:57:26.145607 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Identity-Status: Confirmed Sep 20 04:57:26.145607 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Is-Admin-Project: True Sep 20 04:57:26.145607 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Id: default Sep 20 04:57:26.145607 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Name: Default Sep 20 04:57:26.145607 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Id: 5f0a24f6f6994f45bd314d3009b0a572 Sep 20 04:57:26.145607 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-447939399 Sep 20 04:57:26.145607 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Role: reader,member Sep 20 04:57:26.145607 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Roles: reader,member Sep 20 04:57:26.147204 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5f0a24f6f6994f45bd314d3009b0a572"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5f0a24f6f6994f45bd314d3009b0a572"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5f0a24f6f6994f45bd314d3009b0a572", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5f0a24f6f6994f45bd314d3009b0a572"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 04:57:26.147204 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant: tempest-ServerRescueNegativeTestJSON-447939399 Sep 20 04:57:26.147204 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Id: 5f0a24f6f6994f45bd314d3009b0a572 Sep 20 04:57:26.147204 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-447939399 Sep 20 04:57:26.147204 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User: tempest-ServerRescueNegativeTestJSON-447939399-project Sep 20 04:57:26.147204 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Id: default Sep 20 04:57:26.147204 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Name: Default Sep 20 04:57:26.147204 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Id: 49f80b68650940e8850cbd4f84a49ef4 Sep 20 04:57:26.147204 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Name: tempest-ServerRescueNegativeTestJSON-447939399-project Sep 20 04:57:26.147204 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: method: > Sep 20 04:57:26.147204 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: exception: Instance d4e85593-565d-40c6-bed2-121ca9466654 could not be found. Sep 20 04:57:26.147204 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: action_args: {'id': 'd4e85593-565d-40c6-bed2-121ca9466654'} Sep 20 04:57:26.148246 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 04:57:26.148246 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:57:26.148246 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 04:57:26.148246 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 04:57:26.148246 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 04:57:26.148246 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 04:57:26.148246 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 04:57:26.148246 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 04:57:26.148246 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 04:57:26.148246 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 04:57:26.148246 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4e85593-565d-40c6-bed2-121ca9466654 could not be found. Sep 20 04:57:26.148246 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:57:26.148246 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:57:26.148246 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:57:26.148246 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:57:26.148246 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:57:26.148246 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:57:26.148246 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 04:57:26.148246 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 04:57:26.148246 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 04:57:26.149863 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 04:57:26.149863 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 04:57:26.149863 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 04:57:26.149863 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 04:57:26.149863 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 04:57:26.149863 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 04:57:26.149863 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 04:57:26.149863 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4e85593-565d-40c6-bed2-121ca9466654 could not be found. Sep 20 04:57:26.149863 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:57:26.149863 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:57:26.149863 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:57:26.149863 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:57:26.149863 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:57:26.149863 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:57:26.149863 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 04:57:26.149863 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 04:57:26.149863 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4e85593-565d-40c6-bed2-121ca9466654 could not be found. Sep 20 04:57:26.149863 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:57:26.152303 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-c356efd2-3868-411d-86c3-1c630f0b9ae2 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Returning 404 to user: Instance d4e85593-565d-40c6-bed2-121ca9466654 could not be found. {{(pid=126813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 04:57:26.152303 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-c356efd2-3868-411d-86c3-1c630f0b9ae2 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654" status: 404 len: 111 microversion: 2.1 time: 0.031105 Sep 20 04:57:26.152303 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 362/512] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:57:26 2022] GET /compute/v2.1/servers/d4e85593-565d-40c6-bed2-121ca9466654 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 20 04:57:26.155690 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-881da31b-bcd9-4348-9c47-fca6bc15be19 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:26.156176 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-881da31b-bcd9-4348-9c47-fca6bc15be19 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:26.161981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-881da31b-bcd9-4348-9c47-fca6bc15be19 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:26.162457 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-881da31b-bcd9-4348-9c47-fca6bc15be19 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:26.162893 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-881da31b-bcd9-4348-9c47-fca6bc15be19 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:26.163567 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-881da31b-bcd9-4348-9c47-fca6bc15be19 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:26.164072 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-881da31b-bcd9-4348-9c47-fca6bc15be19 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:26.164501 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-881da31b-bcd9-4348-9c47-fca6bc15be19 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:26.189372 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-881da31b-bcd9-4348-9c47-fca6bc15be19 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2] Going to try to terminate instance {{(pid=126813) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 20 04:57:26.260269 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-881da31b-bcd9-4348-9c47-fca6bc15be19 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "DELETE /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2" status: 204 len: 0 microversion: 2.1 time: 0.107460 Sep 20 04:57:26.260860 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 363/513] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Sep 20 04:57:26 2022] DELETE /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 20 04:57:26.269138 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-15dafc75-d50b-4154-a935-9bd84705b3e3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:26.269821 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-15dafc75-d50b-4154-a935-9bd84705b3e3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:26.275295 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-15dafc75-d50b-4154-a935-9bd84705b3e3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:26.276304 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-15dafc75-d50b-4154-a935-9bd84705b3e3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:26.276775 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-15dafc75-d50b-4154-a935-9bd84705b3e3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:26.277450 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-15dafc75-d50b-4154-a935-9bd84705b3e3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:26.277897 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-15dafc75-d50b-4154-a935-9bd84705b3e3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:26.278314 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-15dafc75-d50b-4154-a935-9bd84705b3e3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:26.410138 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-15dafc75-d50b-4154-a935-9bd84705b3e3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:26.417949 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-15dafc75-d50b-4154-a935-9bd84705b3e3 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2" status: 200 len: 1523 microversion: 2.1 time: 0.152932 Sep 20 04:57:26.418506 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 364/514] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:57:26 2022] GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:57:26.422772 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-05d6784e-8826-4eb8-87d9-bc8f92dccc9f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:26.423373 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-05d6784e-8826-4eb8-87d9-bc8f92dccc9f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 0f0fd5e7-f601-4fa1-870a-b2c497479260] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:26.429183 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-05d6784e-8826-4eb8-87d9-bc8f92dccc9f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:26.429660 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-05d6784e-8826-4eb8-87d9-bc8f92dccc9f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:26.430095 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-05d6784e-8826-4eb8-87d9-bc8f92dccc9f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:26.430774 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-05d6784e-8826-4eb8-87d9-bc8f92dccc9f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:26.431253 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-05d6784e-8826-4eb8-87d9-bc8f92dccc9f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:26.432234 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-05d6784e-8826-4eb8-87d9-bc8f92dccc9f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:26.562905 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-05d6784e-8826-4eb8-87d9-bc8f92dccc9f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:26.570711 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-05d6784e-8826-4eb8-87d9-bc8f92dccc9f tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/0f0fd5e7-f601-4fa1-870a-b2c497479260" status: 200 len: 1365 microversion: 2.1 time: 0.151267 Sep 20 04:57:26.571270 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 365/515] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:57:26 2022] GET /compute/v2.1/servers/0f0fd5e7-f601-4fa1-870a-b2c497479260 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:57:27.441164 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-4d4212ab-d796-4687-b675-be0aead84f1d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:27.441825 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-4d4212ab-d796-4687-b675-be0aead84f1d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:27.448733 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4d4212ab-d796-4687-b675-be0aead84f1d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:27.449210 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4d4212ab-d796-4687-b675-be0aead84f1d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:27.449640 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4d4212ab-d796-4687-b675-be0aead84f1d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:27.450320 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4d4212ab-d796-4687-b675-be0aead84f1d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:27.450770 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4d4212ab-d796-4687-b675-be0aead84f1d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:27.451191 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4d4212ab-d796-4687-b675-be0aead84f1d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:27.574684 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-4d4212ab-d796-4687-b675-be0aead84f1d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:27.582417 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-4d4212ab-d796-4687-b675-be0aead84f1d tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2" status: 200 len: 1523 microversion: 2.1 time: 0.145188 Sep 20 04:57:27.582982 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 366/516] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:57:27 2022] GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 => generated 1523 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:57:27.594359 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-2b9ea224-6b4d-41b4-b1ec-a14cbfbb795a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:27.594963 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-2b9ea224-6b4d-41b4-b1ec-a14cbfbb795a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 0f0fd5e7-f601-4fa1-870a-b2c497479260] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:27.600674 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2b9ea224-6b4d-41b4-b1ec-a14cbfbb795a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:27.601157 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2b9ea224-6b4d-41b4-b1ec-a14cbfbb795a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:27.601584 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2b9ea224-6b4d-41b4-b1ec-a14cbfbb795a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:27.602256 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2b9ea224-6b4d-41b4-b1ec-a14cbfbb795a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:27.602702 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2b9ea224-6b4d-41b4-b1ec-a14cbfbb795a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:27.603119 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2b9ea224-6b4d-41b4-b1ec-a14cbfbb795a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:27.729683 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-2b9ea224-6b4d-41b4-b1ec-a14cbfbb795a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:27.737469 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-2b9ea224-6b4d-41b4-b1ec-a14cbfbb795a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/0f0fd5e7-f601-4fa1-870a-b2c497479260" status: 200 len: 1365 microversion: 2.1 time: 0.146628 Sep 20 04:57:27.738039 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 367/517] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:57:27 2022] GET /compute/v2.1/servers/0f0fd5e7-f601-4fa1-870a-b2c497479260 => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:57:28.606231 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-7513289a-218a-4ca6-b247-6a233f0b776f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:28.606947 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-7513289a-218a-4ca6-b247-6a233f0b776f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:28.613344 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7513289a-218a-4ca6-b247-6a233f0b776f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:28.613831 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7513289a-218a-4ca6-b247-6a233f0b776f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:28.614269 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7513289a-218a-4ca6-b247-6a233f0b776f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:28.614953 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7513289a-218a-4ca6-b247-6a233f0b776f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:28.615407 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7513289a-218a-4ca6-b247-6a233f0b776f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:28.615827 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7513289a-218a-4ca6-b247-6a233f0b776f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:28.741007 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-7513289a-218a-4ca6-b247-6a233f0b776f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:28.748730 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-7513289a-218a-4ca6-b247-6a233f0b776f tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2" status: 200 len: 1523 microversion: 2.1 time: 0.147359 Sep 20 04:57:28.749293 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 368/518] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:57:28 2022] GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:57:28.759890 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-9446ec67-c1b9-40f1-a7d0-c7c06f97908b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:28.760624 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-9446ec67-c1b9-40f1-a7d0-c7c06f97908b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 0f0fd5e7-f601-4fa1-870a-b2c497479260] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:28.766541 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9446ec67-c1b9-40f1-a7d0-c7c06f97908b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:28.767053 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9446ec67-c1b9-40f1-a7d0-c7c06f97908b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:28.767484 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9446ec67-c1b9-40f1-a7d0-c7c06f97908b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:28.768337 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9446ec67-c1b9-40f1-a7d0-c7c06f97908b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:28.768809 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9446ec67-c1b9-40f1-a7d0-c7c06f97908b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:28.769230 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9446ec67-c1b9-40f1-a7d0-c7c06f97908b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:28.954083 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-9446ec67-c1b9-40f1-a7d0-c7c06f97908b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:28.962081 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-9446ec67-c1b9-40f1-a7d0-c7c06f97908b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/0f0fd5e7-f601-4fa1-870a-b2c497479260" status: 200 len: 1365 microversion: 2.1 time: 0.205608 Sep 20 04:57:28.962674 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 369/519] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:57:28 2022] GET /compute/v2.1/servers/0f0fd5e7-f601-4fa1-870a-b2c497479260 => generated 1365 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:57:29.737670 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-c784b0dc-4680-40f1-883b-b42be3a5446a req-48ed5c33-8cc0-4435-bb2d-9b5461066b67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2", "name": "network-vif-deleted", "tag": "e7732f19-361c-4723-a7a3-dd9abf4593ea"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:57:29.748587 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-c784b0dc-4680-40f1-883b-b42be3a5446a req-48ed5c33-8cc0-4435-bb2d-9b5461066b67 service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:29.749091 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-c784b0dc-4680-40f1-883b-b42be3a5446a req-48ed5c33-8cc0-4435-bb2d-9b5461066b67 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:29.749515 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-c784b0dc-4680-40f1-883b-b42be3a5446a req-48ed5c33-8cc0-4435-bb2d-9b5461066b67 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:29.761786 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-c784b0dc-4680-40f1-883b-b42be3a5446a req-48ed5c33-8cc0-4435-bb2d-9b5461066b67 service nova] Creating event network-vif-deleted:e7732f19-361c-4723-a7a3-dd9abf4593ea for instance 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 on hv-cinder-75671 Sep 20 04:57:29.768098 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-c784b0dc-4680-40f1-883b-b42be3a5446a req-48ed5c33-8cc0-4435-bb2d-9b5461066b67 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033817 Sep 20 04:57:29.769121 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 370/520] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 04:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 04:57:29.774141 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-2627e926-60e5-4abf-9765-45e03f88cfe1 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:29.774831 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-2627e926-60e5-4abf-9765-45e03f88cfe1 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:29.781680 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2627e926-60e5-4abf-9765-45e03f88cfe1 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:29.782157 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2627e926-60e5-4abf-9765-45e03f88cfe1 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:29.782591 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2627e926-60e5-4abf-9765-45e03f88cfe1 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:29.783268 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2627e926-60e5-4abf-9765-45e03f88cfe1 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:29.783717 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2627e926-60e5-4abf-9765-45e03f88cfe1 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:29.784136 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2627e926-60e5-4abf-9765-45e03f88cfe1 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:29.853083 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-2627e926-60e5-4abf-9765-45e03f88cfe1 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f80b68650940e8850cbd4f84a49ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0a24f6f6994f45bd314d3009b0a572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:29.861238 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-2627e926-60e5-4abf-9765-45e03f88cfe1 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2" status: 200 len: 1307 microversion: 2.1 time: 0.090976 Sep 20 04:57:29.861895 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 371/521] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:57:29 2022] GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 => generated 1307 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:57:29.985230 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-d0c0dbc1-0082-4d14-9966-e754bee5f009 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:29.986014 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-d0c0dbc1-0082-4d14-9966-e754bee5f009 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 0f0fd5e7-f601-4fa1-870a-b2c497479260] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:29.992134 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell0:SELECT=2 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:57:29.993660 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d0c0dbc1-0082-4d14-9966-e754bee5f009 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:29.994516 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d0c0dbc1-0082-4d14-9966-e754bee5f009 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:29.994957 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d0c0dbc1-0082-4d14-9966-e754bee5f009 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:29.995822 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d0c0dbc1-0082-4d14-9966-e754bee5f009 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:29.996278 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d0c0dbc1-0082-4d14-9966-e754bee5f009 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:29.996726 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d0c0dbc1-0082-4d14-9966-e754bee5f009 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:30.136136 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell0:SELECT=12 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:57:30.151770 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-d0c0dbc1-0082-4d14-9966-e754bee5f009 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:30.163446 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-d0c0dbc1-0082-4d14-9966-e754bee5f009 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/0f0fd5e7-f601-4fa1-870a-b2c497479260" status: 200 len: 1365 microversion: 2.1 time: 0.182301 Sep 20 04:57:30.164835 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 372/522] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:57:29 2022] GET /compute/v2.1/servers/0f0fd5e7-f601-4fa1-870a-b2c497479260 => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:57:30.169512 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-d0b2869b-912d-41bf-bcdf-85a5a54983d7 req-94fd5fae-9bd8-483c-a9a9-4e0b9c0de549 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f0fd5e7-f601-4fa1-870a-b2c497479260", "name": "network-vif-plugged", "status": "completed", "tag": "7b4bd97f-fb1e-4d96-8371-721ef17b2faf"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:57:30.179918 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-d0b2869b-912d-41bf-bcdf-85a5a54983d7 req-94fd5fae-9bd8-483c-a9a9-4e0b9c0de549 service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:30.181094 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-d0b2869b-912d-41bf-bcdf-85a5a54983d7 req-94fd5fae-9bd8-483c-a9a9-4e0b9c0de549 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:30.182300 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-d0b2869b-912d-41bf-bcdf-85a5a54983d7 req-94fd5fae-9bd8-483c-a9a9-4e0b9c0de549 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:30.200174 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-d0b2869b-912d-41bf-bcdf-85a5a54983d7 req-94fd5fae-9bd8-483c-a9a9-4e0b9c0de549 service nova] Creating event network-vif-plugged:7b4bd97f-fb1e-4d96-8371-721ef17b2faf for instance 0f0fd5e7-f601-4fa1-870a-b2c497479260 on hv-cinder-75671 Sep 20 04:57:30.205788 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-d0b2869b-912d-41bf-bcdf-85a5a54983d7 req-94fd5fae-9bd8-483c-a9a9-4e0b9c0de549 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039654 Sep 20 04:57:30.206394 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 373/523] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 04:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:57:30.885866 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-0ae8f95d-8411-442c-93e3-2191a6363e21 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:30.886564 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-0ae8f95d-8411-442c-93e3-2191a6363e21 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] [instance: 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:30.893037 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0ae8f95d-8411-442c-93e3-2191a6363e21 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:30.893520 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0ae8f95d-8411-442c-93e3-2191a6363e21 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:30.893959 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0ae8f95d-8411-442c-93e3-2191a6363e21 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:30.894643 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0ae8f95d-8411-442c-93e3-2191a6363e21 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:30.895093 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0ae8f95d-8411-442c-93e3-2191a6363e21 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:30.895517 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0ae8f95d-8411-442c-93e3-2191a6363e21 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:30.908695 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.wsgi [None req-0ae8f95d-8411-442c-93e3-2191a6363e21 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] HTTP exception thrown: Instance 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 could not be found. Sep 20 04:57:30.910283 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-0ae8f95d-8411-442c-93e3-2191a6363e21 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Request method failure captured: Sep 20 04:57:30.910283 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: request: GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 HTTP/1.1 Sep 20 04:57:30.910283 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept: application/json Sep 20 04:57:30.910283 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept-Encoding: identity Sep 20 04:57:30.910283 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Connection: close Sep 20 04:57:30.910283 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Length: 0 Sep 20 04:57:30.910283 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Type: application/json Sep 20 04:57:30.910283 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Host: 10.222.0.27 Sep 20 04:57:30.910283 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Openstack-System-Scope: None Sep 20 04:57:30.910283 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: User-Agent: python-urllib3/1.26.12 Sep 20 04:57:30.910283 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Auth-Token: gAAAAABjKUbuqmu710n-3SCVM36yM7K-f797gToLzqjsDE8VJysUBrvG5j-mQzogHDlEQu9N838xq1zWP21_6m2gF-Ihax1sPUYdHwZXOTHQerCv9C5MDRbeGOwZhkLdVG9uye1-Ii1JZSsdS5iGMvHtRw8Q9ofnz0LEtfTZ8xxH8stYtJrOnkg Sep 20 04:57:30.910283 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Id: None Sep 20 04:57:30.910283 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Name: None Sep 20 04:57:30.910283 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Identity-Status: Confirmed Sep 20 04:57:30.910283 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Is-Admin-Project: True Sep 20 04:57:30.910283 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Id: default Sep 20 04:57:30.910283 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Name: Default Sep 20 04:57:30.910283 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Id: 5f0a24f6f6994f45bd314d3009b0a572 Sep 20 04:57:30.910283 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-447939399 Sep 20 04:57:30.910283 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Role: reader,member Sep 20 04:57:30.910283 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Roles: reader,member Sep 20 04:57:30.911747 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5f0a24f6f6994f45bd314d3009b0a572"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5f0a24f6f6994f45bd314d3009b0a572"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5f0a24f6f6994f45bd314d3009b0a572", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5f0a24f6f6994f45bd314d3009b0a572"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 04:57:30.911747 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant: tempest-ServerRescueNegativeTestJSON-447939399 Sep 20 04:57:30.911747 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Id: 5f0a24f6f6994f45bd314d3009b0a572 Sep 20 04:57:30.911747 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-447939399 Sep 20 04:57:30.911747 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User: tempest-ServerRescueNegativeTestJSON-447939399-project Sep 20 04:57:30.911747 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Id: default Sep 20 04:57:30.911747 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Name: Default Sep 20 04:57:30.911747 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Id: 49f80b68650940e8850cbd4f84a49ef4 Sep 20 04:57:30.911747 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Name: tempest-ServerRescueNegativeTestJSON-447939399-project Sep 20 04:57:30.911747 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: method: > Sep 20 04:57:30.911747 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: exception: Instance 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 could not be found. Sep 20 04:57:30.911747 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: action_args: {'id': '208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2'} Sep 20 04:57:30.912725 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 04:57:30.912725 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:57:30.912725 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 04:57:30.912725 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 04:57:30.912725 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 04:57:30.912725 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 04:57:30.912725 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 04:57:30.912725 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 04:57:30.912725 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 04:57:30.912725 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 04:57:30.912725 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 could not be found. Sep 20 04:57:30.912725 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:57:30.912725 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:57:30.912725 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:57:30.912725 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:57:30.912725 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:57:30.912725 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:57:30.912725 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 04:57:30.912725 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 04:57:30.912725 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 04:57:30.914122 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 04:57:30.914122 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 04:57:30.914122 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 04:57:30.914122 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 04:57:30.914122 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 04:57:30.914122 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 04:57:30.914122 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 04:57:30.914122 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 could not be found. Sep 20 04:57:30.914122 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:57:30.914122 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:57:30.914122 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:57:30.914122 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:57:30.914122 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:57:30.914122 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:57:30.914122 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 04:57:30.914122 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 04:57:30.914122 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 could not be found. Sep 20 04:57:30.914122 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:57:30.915481 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-0ae8f95d-8411-442c-93e3-2191a6363e21 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] Returning 404 to user: Instance 208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 could not be found. {{(pid=126813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 04:57:30.915481 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-0ae8f95d-8411-442c-93e3-2191a6363e21 tempest-ServerRescueNegativeTestJSON-447939399 tempest-ServerRescueNegativeTestJSON-447939399-project] 10.222.0.27 "GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2" status: 404 len: 111 microversion: 2.1 time: 0.031240 Sep 20 04:57:30.915481 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 374/524] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:57:30 2022] GET /compute/v2.1/servers/208aaf9d-a2c3-4fd5-a6aa-6d3390959ca2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 20 04:57:31.187980 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-293565d5-7595-4c57-a102-10732f627225 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:31.188685 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-293565d5-7595-4c57-a102-10732f627225 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 0f0fd5e7-f601-4fa1-870a-b2c497479260] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:31.195613 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-293565d5-7595-4c57-a102-10732f627225 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:31.196096 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-293565d5-7595-4c57-a102-10732f627225 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:31.196524 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-293565d5-7595-4c57-a102-10732f627225 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:31.197248 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-293565d5-7595-4c57-a102-10732f627225 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:31.197692 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-293565d5-7595-4c57-a102-10732f627225 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:31.198112 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-293565d5-7595-4c57-a102-10732f627225 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:31.337647 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-293565d5-7595-4c57-a102-10732f627225 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:31.345347 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-293565d5-7595-4c57-a102-10732f627225 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/0f0fd5e7-f601-4fa1-870a-b2c497479260" status: 200 len: 1365 microversion: 2.1 time: 0.161230 Sep 20 04:57:31.345917 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 375/525] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:57:31 2022] GET /compute/v2.1/servers/0f0fd5e7-f601-4fa1-870a-b2c497479260 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:57:32.369388 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-3abd629f-ac03-4477-82c4-a50051feb0f2 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:32.370004 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-3abd629f-ac03-4477-82c4-a50051feb0f2 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 0f0fd5e7-f601-4fa1-870a-b2c497479260] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:32.376025 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3abd629f-ac03-4477-82c4-a50051feb0f2 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:32.376499 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3abd629f-ac03-4477-82c4-a50051feb0f2 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:32.376966 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3abd629f-ac03-4477-82c4-a50051feb0f2 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:32.377676 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3abd629f-ac03-4477-82c4-a50051feb0f2 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:32.378113 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3abd629f-ac03-4477-82c4-a50051feb0f2 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:32.378539 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3abd629f-ac03-4477-82c4-a50051feb0f2 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:32.506428 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-3abd629f-ac03-4477-82c4-a50051feb0f2 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:32.514928 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-3abd629f-ac03-4477-82c4-a50051feb0f2 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/0f0fd5e7-f601-4fa1-870a-b2c497479260" status: 200 len: 1556 microversion: 2.1 time: 0.150112 Sep 20 04:57:32.515499 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 376/526] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:57:32 2022] GET /compute/v2.1/servers/0f0fd5e7-f601-4fa1-870a-b2c497479260 => generated 1556 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:57:32.540203 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-695b923b-418e-4fee-b3a8-df23a7b0cd0b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:32.540750 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-695b923b-418e-4fee-b3a8-df23a7b0cd0b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 0f0fd5e7-f601-4fa1-870a-b2c497479260] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:32.547576 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-695b923b-418e-4fee-b3a8-df23a7b0cd0b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:32.548324 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-695b923b-418e-4fee-b3a8-df23a7b0cd0b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:32.548486 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-695b923b-418e-4fee-b3a8-df23a7b0cd0b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:32.550209 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-695b923b-418e-4fee-b3a8-df23a7b0cd0b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:32.561740 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-695b923b-418e-4fee-b3a8-df23a7b0cd0b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:32.562580 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-695b923b-418e-4fee-b3a8-df23a7b0cd0b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:32.673946 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-695b923b-418e-4fee-b3a8-df23a7b0cd0b tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/0f0fd5e7-f601-4fa1-870a-b2c497479260/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.137494 Sep 20 04:57:32.674546 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 377/527] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Sep 20 04:57:32 2022] GET /compute/v2.1/servers/0f0fd5e7-f601-4fa1-870a-b2c497479260/os-interface => generated 285 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 04:57:33.673943 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-95f73aae-3601-4707-8ac6-13d597a149fb req-4bc49d20-1747-49c2-a28a-48a18ddc5cb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f0fd5e7-f601-4fa1-870a-b2c497479260", "tag": "7b4bd97f-fb1e-4d96-8371-721ef17b2faf"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:57:33.683551 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-95f73aae-3601-4707-8ac6-13d597a149fb req-4bc49d20-1747-49c2-a28a-48a18ddc5cb2 service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:33.684211 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-95f73aae-3601-4707-8ac6-13d597a149fb req-4bc49d20-1747-49c2-a28a-48a18ddc5cb2 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:33.684889 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-95f73aae-3601-4707-8ac6-13d597a149fb req-4bc49d20-1747-49c2-a28a-48a18ddc5cb2 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:33.697853 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-95f73aae-3601-4707-8ac6-13d597a149fb req-4bc49d20-1747-49c2-a28a-48a18ddc5cb2 service nova] Creating event network-changed:7b4bd97f-fb1e-4d96-8371-721ef17b2faf for instance 0f0fd5e7-f601-4fa1-870a-b2c497479260 on hv-cinder-75671 Sep 20 04:57:33.703578 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-95f73aae-3601-4707-8ac6-13d597a149fb req-4bc49d20-1747-49c2-a28a-48a18ddc5cb2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034056 Sep 20 04:57:33.704399 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 378/528] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 04:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 04:57:39.560009 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-61ee2445-7fa5-492f-8a3c-932e8c961e04 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Action: 'create', calling method: .version_select at 0x7f2e4a886310>, body: {"keypair": {"name": "tempest-keypair-966651511", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHP0SifBb+jhTbWW4jKUPn2Qjl4mBv5nAYYzQ0kfo6kAlux2pA4y5qrgjC8zZy1gdlfbXrBtQUsxOdSSSGU0dAYwBycVIpnZunY0a8OKTUrw8OYoG4CvgZN5eY+cR8JIFw=="}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:57:39.577098 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-61ee2445-7fa5-492f-8a3c-932e8c961e04 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Getting quotas for project 56047142d69c4c1cbfa9f6a278622332. Resources: {'key_pairs'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 04:57:39.581569 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-61ee2445-7fa5-492f-8a3c-932e8c961e04 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Getting quotas for user 32cbf88b156745ae9a59e8f795e8ef58 and project 56047142d69c4c1cbfa9f6a278622332. Resources: {'key_pairs'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 04:57:39.605366 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-61ee2445-7fa5-492f-8a3c-932e8c961e04 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.188929 Sep 20 04:57:39.605967 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 379/529] 10.222.0.27 () {62 vars in 1200 bytes} [Tue Sep 20 04:57:39 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 190 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 20 04:57:39.659720 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 20 04:57:39.660203 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: Tue Sep 20 04:57:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.27) !!! Sep 20 04:57:41.161831 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-8973b45e-55fc-40ee-a86a-1489eccce4c9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1644238497", "imageRef": "080ea053-830e-4470-a886-0ab99b0ab3e0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "df11c176-b7e2-4ad1-93ab-93f2f2c98460"}], "security_groups": [{"name": "tempest-securitygroup--757910480"}], "key_name": "tempest-keypair-966651511", "user_data": "}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:57:41.264442 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.network.neutron [None req-8973b45e-55fc-40ee-a86a-1489eccce4c9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] validate_networks() for [('df11c176-b7e2-4ad1-93ab-93f2f2c98460', None, None, None, None, None)] {{(pid=126813) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 20 04:57:41.441538 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:57:41.637140 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-8973b45e-55fc-40ee-a86a-1489eccce4c9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Flavor limits 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 20 04:57:41.637565 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-8973b45e-55fc-40ee-a86a-1489eccce4c9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Image limits 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 20 04:57:41.638039 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-8973b45e-55fc-40ee-a86a-1489eccce4c9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Flavor pref 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 20 04:57:41.638599 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-8973b45e-55fc-40ee-a86a-1489eccce4c9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Image pref 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 20 04:57:41.639043 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-8973b45e-55fc-40ee-a86a-1489eccce4c9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 20 04:57:41.648259 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8973b45e-55fc-40ee-a86a-1489eccce4c9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:41.648819 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8973b45e-55fc-40ee-a86a-1489eccce4c9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:41.649254 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8973b45e-55fc-40ee-a86a-1489eccce4c9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:41.650524 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8973b45e-55fc-40ee-a86a-1489eccce4c9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:41.650977 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8973b45e-55fc-40ee-a86a-1489eccce4c9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:41.651519 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8973b45e-55fc-40ee-a86a-1489eccce4c9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:41.671007 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-8973b45e-55fc-40ee-a86a-1489eccce4c9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Getting quotas for project 56047142d69c4c1cbfa9f6a278622332. Resources: {'ram', 'cores', 'instances'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 04:57:41.675226 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-8973b45e-55fc-40ee-a86a-1489eccce4c9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Getting quotas for user 32cbf88b156745ae9a59e8f795e8ef58 and project 56047142d69c4c1cbfa9f6a278622332. Resources: {'ram', 'cores', 'instances'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 04:57:41.686607 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-8973b45e-55fc-40ee-a86a-1489eccce4c9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Going to run 1 instances... {{(pid=126813) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 20 04:57:41.689082 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-8973b45e-55fc-40ee-a86a-1489eccce4c9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='080ea053-830e-4470-a886-0ab99b0ab3e0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126813) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 20 04:57:41.738650 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-8973b45e-55fc-40ee-a86a-1489eccce4c9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.581787 Sep 20 04:57:41.739469 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 380/530] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Sep 20 04:57:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 20 04:57:41.751244 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-e11c545c-264c-4b2d-8bb9-74bc0936d7b0 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:41.751887 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-e11c545c-264c-4b2d-8bb9-74bc0936d7b0 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:41.806751 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-e11c545c-264c-4b2d-8bb9-74bc0936d7b0 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:41.814595 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-e11c545c-264c-4b2d-8bb9-74bc0936d7b0 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:41.816086 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-e11c545c-264c-4b2d-8bb9-74bc0936d7b0 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:41.817350 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-e11c545c-264c-4b2d-8bb9-74bc0936d7b0 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1281 microversion: 2.20 time: 0.070404 Sep 20 04:57:41.831934 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 381/531] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:57:41 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1281 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 04:57:42.845110 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-34e842e6-c058-4a6d-b34b-50aed087d99a tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:42.846009 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-34e842e6-c058-4a6d-b34b-50aed087d99a tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:42.853866 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-34e842e6-c058-4a6d-b34b-50aed087d99a tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:42.854445 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-34e842e6-c058-4a6d-b34b-50aed087d99a tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:42.854951 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-34e842e6-c058-4a6d-b34b-50aed087d99a tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:42.855758 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-34e842e6-c058-4a6d-b34b-50aed087d99a tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:42.856435 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-34e842e6-c058-4a6d-b34b-50aed087d99a tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:42.857068 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-34e842e6-c058-4a6d-b34b-50aed087d99a tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:42.862049 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:57:42.927334 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-34e842e6-c058-4a6d-b34b-50aed087d99a tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:42.937743 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-34e842e6-c058-4a6d-b34b-50aed087d99a tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:42.939237 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-34e842e6-c058-4a6d-b34b-50aed087d99a tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:42.940432 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-34e842e6-c058-4a6d-b34b-50aed087d99a tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1333 microversion: 2.20 time: 0.100583 Sep 20 04:57:42.941386 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 382/532] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:57:42 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1333 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 04:57:43.969931 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-28bed282-622d-4c28-a1a9-d88bc8e0af62 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:43.970531 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-28bed282-622d-4c28-a1a9-d88bc8e0af62 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:43.977285 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-28bed282-622d-4c28-a1a9-d88bc8e0af62 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:43.978247 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-28bed282-622d-4c28-a1a9-d88bc8e0af62 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:43.978875 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-28bed282-622d-4c28-a1a9-d88bc8e0af62 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:43.979580 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-28bed282-622d-4c28-a1a9-d88bc8e0af62 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:43.980032 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-28bed282-622d-4c28-a1a9-d88bc8e0af62 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:43.980458 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-28bed282-622d-4c28-a1a9-d88bc8e0af62 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:44.129593 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-28bed282-622d-4c28-a1a9-d88bc8e0af62 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:44.144921 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-28bed282-622d-4c28-a1a9-d88bc8e0af62 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:44.146383 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-28bed282-622d-4c28-a1a9-d88bc8e0af62 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:44.147493 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-28bed282-622d-4c28-a1a9-d88bc8e0af62 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1406 microversion: 2.20 time: 0.182550 Sep 20 04:57:44.148061 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 383/533] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:57:43 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 04:57:44.483957 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-94e6a7c1-de93-44ba-a460-92f0fbc266f8 req-074830a1-64f0-4093-9610-994e29be54c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dc0a271-e3e8-4883-b052-72a5c319c6b7", "tag": "91a0df87-3f74-4106-92a9-e9a99f1cd365"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:57:44.493853 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-94e6a7c1-de93-44ba-a460-92f0fbc266f8 req-074830a1-64f0-4093-9610-994e29be54c1 service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:44.494474 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-94e6a7c1-de93-44ba-a460-92f0fbc266f8 req-074830a1-64f0-4093-9610-994e29be54c1 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:44.495792 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-94e6a7c1-de93-44ba-a460-92f0fbc266f8 req-074830a1-64f0-4093-9610-994e29be54c1 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:44.509721 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-94e6a7c1-de93-44ba-a460-92f0fbc266f8 req-074830a1-64f0-4093-9610-994e29be54c1 service nova] Creating event network-changed:91a0df87-3f74-4106-92a9-e9a99f1cd365 for instance 1dc0a271-e3e8-4883-b052-72a5c319c6b7 on hv-cinder-75671 Sep 20 04:57:44.514575 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-94e6a7c1-de93-44ba-a460-92f0fbc266f8 req-074830a1-64f0-4093-9610-994e29be54c1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034297 Sep 20 04:57:44.515182 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 384/534] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 04:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 04:57:45.174178 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-8f8feed2-f495-417d-ad67-84f399d599dc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:45.175252 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-8f8feed2-f495-417d-ad67-84f399d599dc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:45.181092 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8f8feed2-f495-417d-ad67-84f399d599dc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:45.181574 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8f8feed2-f495-417d-ad67-84f399d599dc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:45.182010 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8f8feed2-f495-417d-ad67-84f399d599dc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:45.182702 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8f8feed2-f495-417d-ad67-84f399d599dc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:45.183154 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8f8feed2-f495-417d-ad67-84f399d599dc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:45.183579 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8f8feed2-f495-417d-ad67-84f399d599dc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:45.310533 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-8f8feed2-f495-417d-ad67-84f399d599dc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:45.318877 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-8f8feed2-f495-417d-ad67-84f399d599dc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:45.320330 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-8f8feed2-f495-417d-ad67-84f399d599dc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:45.321493 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-8f8feed2-f495-417d-ad67-84f399d599dc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1406 microversion: 2.20 time: 0.151971 Sep 20 04:57:45.322053 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 385/535] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:57:45 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 04:57:46.346406 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-29cc0db9-e6d1-4e15-bdf2-5b3a54e44596 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:46.347036 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-29cc0db9-e6d1-4e15-bdf2-5b3a54e44596 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:46.354000 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-29cc0db9-e6d1-4e15-bdf2-5b3a54e44596 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:46.354477 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-29cc0db9-e6d1-4e15-bdf2-5b3a54e44596 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:46.354917 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-29cc0db9-e6d1-4e15-bdf2-5b3a54e44596 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:46.355602 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-29cc0db9-e6d1-4e15-bdf2-5b3a54e44596 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:46.356050 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-29cc0db9-e6d1-4e15-bdf2-5b3a54e44596 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:46.356473 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-29cc0db9-e6d1-4e15-bdf2-5b3a54e44596 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:46.485131 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-29cc0db9-e6d1-4e15-bdf2-5b3a54e44596 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:46.493779 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-29cc0db9-e6d1-4e15-bdf2-5b3a54e44596 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:46.495217 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-29cc0db9-e6d1-4e15-bdf2-5b3a54e44596 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:46.496310 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-29cc0db9-e6d1-4e15-bdf2-5b3a54e44596 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1406 microversion: 2.20 time: 0.153863 Sep 20 04:57:46.496899 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 386/536] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:57:46 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 04:57:47.521012 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-fe05cfe9-5a95-4734-89fa-d85a18f41617 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:47.521643 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-fe05cfe9-5a95-4734-89fa-d85a18f41617 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:47.528045 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fe05cfe9-5a95-4734-89fa-d85a18f41617 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:47.528523 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fe05cfe9-5a95-4734-89fa-d85a18f41617 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:47.529000 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fe05cfe9-5a95-4734-89fa-d85a18f41617 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:47.529659 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fe05cfe9-5a95-4734-89fa-d85a18f41617 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:47.530112 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fe05cfe9-5a95-4734-89fa-d85a18f41617 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:47.530534 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fe05cfe9-5a95-4734-89fa-d85a18f41617 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:47.655478 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-fe05cfe9-5a95-4734-89fa-d85a18f41617 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:47.663353 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-fe05cfe9-5a95-4734-89fa-d85a18f41617 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:47.665422 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-fe05cfe9-5a95-4734-89fa-d85a18f41617 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:47.666513 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-fe05cfe9-5a95-4734-89fa-d85a18f41617 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1406 microversion: 2.20 time: 0.149407 Sep 20 04:57:47.667073 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 387/537] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:57:47 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 04:57:48.690830 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-c9b2da76-2e39-42f0-a581-5fc7d4828b97 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:48.691555 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-c9b2da76-2e39-42f0-a581-5fc7d4828b97 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:48.697817 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c9b2da76-2e39-42f0-a581-5fc7d4828b97 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:48.698293 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c9b2da76-2e39-42f0-a581-5fc7d4828b97 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:48.698788 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c9b2da76-2e39-42f0-a581-5fc7d4828b97 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:48.699474 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c9b2da76-2e39-42f0-a581-5fc7d4828b97 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:48.699920 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c9b2da76-2e39-42f0-a581-5fc7d4828b97 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:48.700337 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c9b2da76-2e39-42f0-a581-5fc7d4828b97 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:48.829713 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-c9b2da76-2e39-42f0-a581-5fc7d4828b97 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:48.838529 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-c9b2da76-2e39-42f0-a581-5fc7d4828b97 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:48.839981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-c9b2da76-2e39-42f0-a581-5fc7d4828b97 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:48.841104 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-c9b2da76-2e39-42f0-a581-5fc7d4828b97 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1406 microversion: 2.20 time: 0.154201 Sep 20 04:57:48.841665 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 388/538] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:57:48 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 04:57:49.866096 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-c94feccf-1355-496b-b297-12ed8fb1f39f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:49.866731 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-c94feccf-1355-496b-b297-12ed8fb1f39f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:49.873241 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c94feccf-1355-496b-b297-12ed8fb1f39f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:49.873712 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c94feccf-1355-496b-b297-12ed8fb1f39f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:49.874138 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c94feccf-1355-496b-b297-12ed8fb1f39f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:49.874833 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c94feccf-1355-496b-b297-12ed8fb1f39f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:49.875295 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c94feccf-1355-496b-b297-12ed8fb1f39f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:49.875714 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c94feccf-1355-496b-b297-12ed8fb1f39f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:50.007361 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-c94feccf-1355-496b-b297-12ed8fb1f39f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:50.016314 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-c94feccf-1355-496b-b297-12ed8fb1f39f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:50.017828 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-c94feccf-1355-496b-b297-12ed8fb1f39f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:50.018932 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-c94feccf-1355-496b-b297-12ed8fb1f39f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1406 microversion: 2.20 time: 0.156796 Sep 20 04:57:50.019583 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 389/539] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:57:49 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 04:57:50.207046 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-31e26a59-415a-4deb-96b6-ce1c78f4e46c req-0941753f-20f4-4729-9ea3-700f3a62074e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dc0a271-e3e8-4883-b052-72a5c319c6b7", "name": "network-vif-plugged", "status": "completed", "tag": "91a0df87-3f74-4106-92a9-e9a99f1cd365"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:57:50.217132 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-31e26a59-415a-4deb-96b6-ce1c78f4e46c req-0941753f-20f4-4729-9ea3-700f3a62074e service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:50.217608 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-31e26a59-415a-4deb-96b6-ce1c78f4e46c req-0941753f-20f4-4729-9ea3-700f3a62074e service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:50.218019 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-31e26a59-415a-4deb-96b6-ce1c78f4e46c req-0941753f-20f4-4729-9ea3-700f3a62074e service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:50.228783 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-31e26a59-415a-4deb-96b6-ce1c78f4e46c req-0941753f-20f4-4729-9ea3-700f3a62074e service nova] Creating event network-vif-plugged:91a0df87-3f74-4106-92a9-e9a99f1cd365 for instance 1dc0a271-e3e8-4883-b052-72a5c319c6b7 on hv-cinder-75671 Sep 20 04:57:50.233375 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-31e26a59-415a-4deb-96b6-ce1c78f4e46c req-0941753f-20f4-4729-9ea3-700f3a62074e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085180 Sep 20 04:57:50.233954 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 390/540] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 04:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 04:57:51.044435 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-0777a888-4ea1-4d60-8533-70c6118871ce tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:51.045083 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-0777a888-4ea1-4d60-8533-70c6118871ce tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:51.051170 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0777a888-4ea1-4d60-8533-70c6118871ce tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:51.051645 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0777a888-4ea1-4d60-8533-70c6118871ce tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:51.052073 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0777a888-4ea1-4d60-8533-70c6118871ce tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:51.052799 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0777a888-4ea1-4d60-8533-70c6118871ce tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:51.053248 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0777a888-4ea1-4d60-8533-70c6118871ce tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:51.053669 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0777a888-4ea1-4d60-8533-70c6118871ce tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:51.183556 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-0777a888-4ea1-4d60-8533-70c6118871ce tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:51.191652 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-0777a888-4ea1-4d60-8533-70c6118871ce tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:51.193147 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-0777a888-4ea1-4d60-8533-70c6118871ce tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:51.194248 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-0777a888-4ea1-4d60-8533-70c6118871ce tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1406 microversion: 2.20 time: 0.154694 Sep 20 04:57:51.194796 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 391/541] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:57:51 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 04:57:52.219897 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-0333377e-4f5e-493a-9231-32c212e1b9af tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:52.220511 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-0333377e-4f5e-493a-9231-32c212e1b9af tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:52.222508 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell0:SELECT=2 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:57:52.223198 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell0:SELECT=12 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:57:52.230212 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0333377e-4f5e-493a-9231-32c212e1b9af tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:52.230693 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0333377e-4f5e-493a-9231-32c212e1b9af tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:52.231131 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0333377e-4f5e-493a-9231-32c212e1b9af tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:52.231855 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0333377e-4f5e-493a-9231-32c212e1b9af tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:52.232310 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0333377e-4f5e-493a-9231-32c212e1b9af tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:52.232772 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0333377e-4f5e-493a-9231-32c212e1b9af tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:52.362633 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-0333377e-4f5e-493a-9231-32c212e1b9af tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:52.370672 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-0333377e-4f5e-493a-9231-32c212e1b9af tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:52.372136 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-0333377e-4f5e-493a-9231-32c212e1b9af tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:57:52.373300 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-0333377e-4f5e-493a-9231-32c212e1b9af tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1597 microversion: 2.20 time: 0.157378 Sep 20 04:57:52.373857 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 392/542] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:57:52 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1597 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 04:57:52.397215 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-512b7364-ee9a-403b-8d10-38a83c70f751 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:57:52.397699 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-512b7364-ee9a-403b-8d10-38a83c70f751 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:57:52.403733 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-512b7364-ee9a-403b-8d10-38a83c70f751 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:52.404208 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-512b7364-ee9a-403b-8d10-38a83c70f751 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:52.404669 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-512b7364-ee9a-403b-8d10-38a83c70f751 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:52.405347 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-512b7364-ee9a-403b-8d10-38a83c70f751 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:52.405797 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-512b7364-ee9a-403b-8d10-38a83c70f751 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:52.406215 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-512b7364-ee9a-403b-8d10-38a83c70f751 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:52.481695 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-512b7364-ee9a-403b-8d10-38a83c70f751 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.087888 Sep 20 04:57:52.482360 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 393/543] 10.222.0.27 () {60 vars in 1316 bytes} [Tue Sep 20 04:57:52 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 20 04:57:53.390892 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-c3c9539f-f3ed-4132-962e-fb9064ac8e32 req-0a0adbf4-ccdd-4ceb-ae45-55a7555d0339 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dc0a271-e3e8-4883-b052-72a5c319c6b7", "tag": "91a0df87-3f74-4106-92a9-e9a99f1cd365"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:57:53.400930 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-c3c9539f-f3ed-4132-962e-fb9064ac8e32 req-0a0adbf4-ccdd-4ceb-ae45-55a7555d0339 service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:57:53.401437 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-c3c9539f-f3ed-4132-962e-fb9064ac8e32 req-0a0adbf4-ccdd-4ceb-ae45-55a7555d0339 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:57:53.401868 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-c3c9539f-f3ed-4132-962e-fb9064ac8e32 req-0a0adbf4-ccdd-4ceb-ae45-55a7555d0339 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:57:53.412900 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-c3c9539f-f3ed-4132-962e-fb9064ac8e32 req-0a0adbf4-ccdd-4ceb-ae45-55a7555d0339 service nova] Creating event network-changed:91a0df87-3f74-4106-92a9-e9a99f1cd365 for instance 1dc0a271-e3e8-4883-b052-72a5c319c6b7 on hv-cinder-75671 Sep 20 04:57:53.418583 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-c3c9539f-f3ed-4132-962e-fb9064ac8e32 req-0a0adbf4-ccdd-4ceb-ae45-55a7555d0339 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031971 Sep 20 04:57:53.419310 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 394/544] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 04:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 04:58:08.895734 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-f2a8345a-4ef6-4e47-816c-e0d752076a4a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:58:08.896437 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-f2a8345a-4ef6-4e47-816c-e0d752076a4a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 0f0fd5e7-f601-4fa1-870a-b2c497479260] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:58:08.899355 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:58:08.899991 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell1:SELECT=62 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:58:08.906713 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f2a8345a-4ef6-4e47-816c-e0d752076a4a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:08.907197 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f2a8345a-4ef6-4e47-816c-e0d752076a4a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:08.907659 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f2a8345a-4ef6-4e47-816c-e0d752076a4a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:08.908384 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f2a8345a-4ef6-4e47-816c-e0d752076a4a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:08.908870 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f2a8345a-4ef6-4e47-816c-e0d752076a4a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:08.909290 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f2a8345a-4ef6-4e47-816c-e0d752076a4a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:08.933412 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-f2a8345a-4ef6-4e47-816c-e0d752076a4a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/0f0fd5e7-f601-4fa1-870a-b2c497479260/ips" status: 200 len: 151 microversion: 2.1 time: 0.041926 Sep 20 04:58:08.933968 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 395/545] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Sep 20 04:58:08 2022] GET /compute/v2.1/servers/0f0fd5e7-f601-4fa1-870a-b2c497479260/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 04:58:10.270514 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-7fb472b5-be4c-4b92-abfc-6e0e101604d2 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5148a1c8-03e2-4755-9d9d-4bec6a0fcaa0"}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:58:10.272899 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-7fb472b5-be4c-4b92-abfc-6e0e101604d2 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 0f0fd5e7-f601-4fa1-870a-b2c497479260] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:58:10.279389 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7fb472b5-be4c-4b92-abfc-6e0e101604d2 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:10.280654 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7fb472b5-be4c-4b92-abfc-6e0e101604d2 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:10.283220 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7fb472b5-be4c-4b92-abfc-6e0e101604d2 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:10.283922 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7fb472b5-be4c-4b92-abfc-6e0e101604d2 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:10.284384 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7fb472b5-be4c-4b92-abfc-6e0e101604d2 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:10.284854 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7fb472b5-be4c-4b92-abfc-6e0e101604d2 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:10.533815 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-7fb472b5-be4c-4b92-abfc-6e0e101604d2 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "POST /compute/v2.1/servers/0f0fd5e7-f601-4fa1-870a-b2c497479260/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266984 Sep 20 04:58:10.534410 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 396/546] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Sep 20 04:58:10 2022] POST /compute/v2.1/servers/0f0fd5e7-f601-4fa1-870a-b2c497479260/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 04:58:18.184952 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-2b8e2d36-1a1e-488c-8715-1a19b5b1c634 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:58:18.185538 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-2b8e2d36-1a1e-488c-8715-1a19b5b1c634 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 0f0fd5e7-f601-4fa1-870a-b2c497479260] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:58:18.191730 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2b8e2d36-1a1e-488c-8715-1a19b5b1c634 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:18.192218 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2b8e2d36-1a1e-488c-8715-1a19b5b1c634 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:18.192679 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2b8e2d36-1a1e-488c-8715-1a19b5b1c634 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:18.193370 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2b8e2d36-1a1e-488c-8715-1a19b5b1c634 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:18.193829 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2b8e2d36-1a1e-488c-8715-1a19b5b1c634 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:18.194253 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2b8e2d36-1a1e-488c-8715-1a19b5b1c634 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:18.274541 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.objects.instance [None req-2b8e2d36-1a1e-488c-8715-1a19b5b1c634 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lazy-loading 'services' on Instance uuid 0f0fd5e7-f601-4fa1-870a-b2c497479260 {{(pid=126813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 04:58:18.344827 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-2b8e2d36-1a1e-488c-8715-1a19b5b1c634 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0f0fd5e7-f601-4fa1-870a-b2c497479260/os-volume_attachments/5148a1c8-03e2-4755-9d9d-4bec6a0fcaa0" status: 202 len: 0 microversion: 2.1 time: 0.164954 Sep 20 04:58:18.345447 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 397/547] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Sep 20 04:58:18 2022] DELETE /compute/v2.1/servers/0f0fd5e7-f601-4fa1-870a-b2c497479260/os-volume_attachments/5148a1c8-03e2-4755-9d9d-4bec6a0fcaa0 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 20 04:58:18.354900 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-0b0f61c4-906a-4bed-b6b4-6b45ad3a67e2 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:58:18.357243 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-0b0f61c4-906a-4bed-b6b4-6b45ad3a67e2 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 0f0fd5e7-f601-4fa1-870a-b2c497479260] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:58:18.363539 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0b0f61c4-906a-4bed-b6b4-6b45ad3a67e2 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:18.364048 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0b0f61c4-906a-4bed-b6b4-6b45ad3a67e2 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:18.364456 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0b0f61c4-906a-4bed-b6b4-6b45ad3a67e2 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:18.365163 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0b0f61c4-906a-4bed-b6b4-6b45ad3a67e2 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:18.365611 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0b0f61c4-906a-4bed-b6b4-6b45ad3a67e2 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:18.366032 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0b0f61c4-906a-4bed-b6b4-6b45ad3a67e2 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:18.398347 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-0b0f61c4-906a-4bed-b6b4-6b45ad3a67e2 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/0f0fd5e7-f601-4fa1-870a-b2c497479260/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048542 Sep 20 04:58:18.398941 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 398/548] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Sep 20 04:58:18 2022] GET /compute/v2.1/servers/0f0fd5e7-f601-4fa1-870a-b2c497479260/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 04:58:19.410805 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-f29665c2-6b4e-475d-a946-9de3bde2201a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:58:19.412857 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-f29665c2-6b4e-475d-a946-9de3bde2201a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 0f0fd5e7-f601-4fa1-870a-b2c497479260] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:58:19.419286 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f29665c2-6b4e-475d-a946-9de3bde2201a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:19.419758 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f29665c2-6b4e-475d-a946-9de3bde2201a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:19.420218 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f29665c2-6b4e-475d-a946-9de3bde2201a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:19.420916 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f29665c2-6b4e-475d-a946-9de3bde2201a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:19.421360 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f29665c2-6b4e-475d-a946-9de3bde2201a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:19.421781 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f29665c2-6b4e-475d-a946-9de3bde2201a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:19.450284 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-f29665c2-6b4e-475d-a946-9de3bde2201a tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/0f0fd5e7-f601-4fa1-870a-b2c497479260/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043460 Sep 20 04:58:19.450819 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 399/549] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Sep 20 04:58:19 2022] GET /compute/v2.1/servers/0f0fd5e7-f601-4fa1-870a-b2c497479260/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 20 04:58:19.516762 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-3ee55a4e-7d61-4409-b059-13d8c4af4429 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:58:19.517289 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-3ee55a4e-7d61-4409-b059-13d8c4af4429 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 0f0fd5e7-f601-4fa1-870a-b2c497479260] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:58:19.523154 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3ee55a4e-7d61-4409-b059-13d8c4af4429 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:19.523636 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3ee55a4e-7d61-4409-b059-13d8c4af4429 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:19.524074 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3ee55a4e-7d61-4409-b059-13d8c4af4429 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:19.524789 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3ee55a4e-7d61-4409-b059-13d8c4af4429 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:19.525242 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3ee55a4e-7d61-4409-b059-13d8c4af4429 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:19.525667 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3ee55a4e-7d61-4409-b059-13d8c4af4429 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:19.549619 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-3ee55a4e-7d61-4409-b059-13d8c4af4429 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 0f0fd5e7-f601-4fa1-870a-b2c497479260] Going to try to terminate instance {{(pid=126813) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 20 04:58:19.623273 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-3ee55a4e-7d61-4409-b059-13d8c4af4429 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0f0fd5e7-f601-4fa1-870a-b2c497479260" status: 204 len: 0 microversion: 2.1 time: 0.110269 Sep 20 04:58:19.623978 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 400/550] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Sep 20 04:58:19 2022] DELETE /compute/v2.1/servers/0f0fd5e7-f601-4fa1-870a-b2c497479260 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 20 04:58:19.637488 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-213c361e-48eb-43b8-baa3-5d45c654f132 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:58:19.638188 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-213c361e-48eb-43b8-baa3-5d45c654f132 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 0f0fd5e7-f601-4fa1-870a-b2c497479260] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:58:19.644302 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-213c361e-48eb-43b8-baa3-5d45c654f132 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:19.644812 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-213c361e-48eb-43b8-baa3-5d45c654f132 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:19.645246 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-213c361e-48eb-43b8-baa3-5d45c654f132 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:19.645928 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-213c361e-48eb-43b8-baa3-5d45c654f132 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:19.646377 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-213c361e-48eb-43b8-baa3-5d45c654f132 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:19.646802 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-213c361e-48eb-43b8-baa3-5d45c654f132 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:19.775918 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-213c361e-48eb-43b8-baa3-5d45c654f132 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:19.783623 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-213c361e-48eb-43b8-baa3-5d45c654f132 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/0f0fd5e7-f601-4fa1-870a-b2c497479260" status: 200 len: 1681 microversion: 2.1 time: 0.150974 Sep 20 04:58:19.784181 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 401/551] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:58:19 2022] GET /compute/v2.1/servers/0f0fd5e7-f601-4fa1-870a-b2c497479260 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:58:20.807972 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-7745114b-83cd-4184-b423-d1d6fc223e81 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:58:20.808628 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-7745114b-83cd-4184-b423-d1d6fc223e81 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 0f0fd5e7-f601-4fa1-870a-b2c497479260] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:58:20.815059 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7745114b-83cd-4184-b423-d1d6fc223e81 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:20.815535 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7745114b-83cd-4184-b423-d1d6fc223e81 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:20.815964 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7745114b-83cd-4184-b423-d1d6fc223e81 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:20.816665 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7745114b-83cd-4184-b423-d1d6fc223e81 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:20.817114 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7745114b-83cd-4184-b423-d1d6fc223e81 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:20.817533 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7745114b-83cd-4184-b423-d1d6fc223e81 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:20.942407 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-7745114b-83cd-4184-b423-d1d6fc223e81 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:20.950203 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-7745114b-83cd-4184-b423-d1d6fc223e81 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/0f0fd5e7-f601-4fa1-870a-b2c497479260" status: 200 len: 1681 microversion: 2.1 time: 0.146635 Sep 20 04:58:20.950762 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 402/552] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:58:20 2022] GET /compute/v2.1/servers/0f0fd5e7-f601-4fa1-870a-b2c497479260 => generated 1681 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:58:21.973857 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-9fe559b5-8505-4718-acb6-fa6cdf213cb7 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:58:21.975152 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-9fe559b5-8505-4718-acb6-fa6cdf213cb7 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 0f0fd5e7-f601-4fa1-870a-b2c497479260] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:58:21.981630 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9fe559b5-8505-4718-acb6-fa6cdf213cb7 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:21.982110 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9fe559b5-8505-4718-acb6-fa6cdf213cb7 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:21.982541 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9fe559b5-8505-4718-acb6-fa6cdf213cb7 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:21.983221 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9fe559b5-8505-4718-acb6-fa6cdf213cb7 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:21.983667 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9fe559b5-8505-4718-acb6-fa6cdf213cb7 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:21.984083 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9fe559b5-8505-4718-acb6-fa6cdf213cb7 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:22.116184 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-9fe559b5-8505-4718-acb6-fa6cdf213cb7 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93f22104a7b4a7caf0cc8b7180ffc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0f0b8842ae496292c27a6ee1350d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:22.125134 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-9fe559b5-8505-4718-acb6-fa6cdf213cb7 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/0f0fd5e7-f601-4fa1-870a-b2c497479260" status: 200 len: 1681 microversion: 2.1 time: 0.154975 Sep 20 04:58:22.136944 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 403/553] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:58:21 2022] GET /compute/v2.1/servers/0f0fd5e7-f601-4fa1-870a-b2c497479260 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:58:22.474608 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-1152a225-ce2b-430c-adc2-95a2a0959646 req-d9666b76-ada7-47e8-ad05-3c029339fd12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f0fd5e7-f601-4fa1-870a-b2c497479260", "name": "network-vif-deleted", "tag": "7b4bd97f-fb1e-4d96-8371-721ef17b2faf"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:58:22.484834 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-1152a225-ce2b-430c-adc2-95a2a0959646 req-d9666b76-ada7-47e8-ad05-3c029339fd12 service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:22.485423 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-1152a225-ce2b-430c-adc2-95a2a0959646 req-d9666b76-ada7-47e8-ad05-3c029339fd12 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:22.485916 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-1152a225-ce2b-430c-adc2-95a2a0959646 req-d9666b76-ada7-47e8-ad05-3c029339fd12 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:22.497170 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-1152a225-ce2b-430c-adc2-95a2a0959646 req-d9666b76-ada7-47e8-ad05-3c029339fd12 service nova] Creating event network-vif-deleted:7b4bd97f-fb1e-4d96-8371-721ef17b2faf for instance 0f0fd5e7-f601-4fa1-870a-b2c497479260 on hv-cinder-75671 Sep 20 04:58:22.501952 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-1152a225-ce2b-430c-adc2-95a2a0959646 req-d9666b76-ada7-47e8-ad05-3c029339fd12 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031160 Sep 20 04:58:22.502946 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 404/554] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 04:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:58:23.152715 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-1e89c5b9-69e8-4fc8-8bd0-3f4f8f07aad1 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:58:23.153441 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-1e89c5b9-69e8-4fc8-8bd0-3f4f8f07aad1 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 0f0fd5e7-f601-4fa1-870a-b2c497479260] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:58:23.159690 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1e89c5b9-69e8-4fc8-8bd0-3f4f8f07aad1 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:23.160167 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1e89c5b9-69e8-4fc8-8bd0-3f4f8f07aad1 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:23.160630 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1e89c5b9-69e8-4fc8-8bd0-3f4f8f07aad1 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:23.161314 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1e89c5b9-69e8-4fc8-8bd0-3f4f8f07aad1 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:23.161758 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1e89c5b9-69e8-4fc8-8bd0-3f4f8f07aad1 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:23.162176 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1e89c5b9-69e8-4fc8-8bd0-3f4f8f07aad1 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:23.176076 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.wsgi [None req-1e89c5b9-69e8-4fc8-8bd0-3f4f8f07aad1 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] HTTP exception thrown: Instance 0f0fd5e7-f601-4fa1-870a-b2c497479260 could not be found. Sep 20 04:58:23.177753 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-1e89c5b9-69e8-4fc8-8bd0-3f4f8f07aad1 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Request method failure captured: Sep 20 04:58:23.177753 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: request: GET /compute/v2.1/servers/0f0fd5e7-f601-4fa1-870a-b2c497479260 HTTP/1.1 Sep 20 04:58:23.177753 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept: application/json Sep 20 04:58:23.177753 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept-Encoding: identity Sep 20 04:58:23.177753 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Connection: close Sep 20 04:58:23.177753 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Length: 0 Sep 20 04:58:23.177753 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Type: application/json Sep 20 04:58:23.177753 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Host: 10.222.0.27 Sep 20 04:58:23.177753 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Openstack-System-Scope: None Sep 20 04:58:23.177753 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: User-Agent: python-urllib3/1.26.12 Sep 20 04:58:23.177753 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Auth-Token: gAAAAABjKUbv3hCswc9OTl1x4i1QFI6XV3GUT2FYN7UTgjG9dzuM3jqx_GcwO4w0JWwRz9sTS2WwajnGfx2wJ2_1hAz4UUEc_snPtCtdpEIJJc5Fb8lrnltNsG7f_iYNiB6Uy9F1dOvGdMIHwFbxpPMJ6tdvqkqh2eaYhvMGxVgemwP0gnqQm2U Sep 20 04:58:23.177753 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Id: None Sep 20 04:58:23.177753 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Name: None Sep 20 04:58:23.177753 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Identity-Status: Confirmed Sep 20 04:58:23.177753 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Is-Admin-Project: True Sep 20 04:58:23.177753 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Id: default Sep 20 04:58:23.177753 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Name: Default Sep 20 04:58:23.177753 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Id: 4f0f0b8842ae496292c27a6ee1350d32 Sep 20 04:58:23.177753 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Name: tempest-AttachVolumeNegativeTest-1482924724 Sep 20 04:58:23.177753 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Role: reader,member Sep 20 04:58:23.177753 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Roles: reader,member Sep 20 04:58:23.179372 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f0f0b8842ae496292c27a6ee1350d32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f0f0b8842ae496292c27a6ee1350d32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4f0f0b8842ae496292c27a6ee1350d32", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4f0f0b8842ae496292c27a6ee1350d32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 04:58:23.179372 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant: tempest-AttachVolumeNegativeTest-1482924724 Sep 20 04:58:23.179372 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Id: 4f0f0b8842ae496292c27a6ee1350d32 Sep 20 04:58:23.179372 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1482924724 Sep 20 04:58:23.179372 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User: tempest-AttachVolumeNegativeTest-1482924724-project Sep 20 04:58:23.179372 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Id: default Sep 20 04:58:23.179372 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Name: Default Sep 20 04:58:23.179372 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Id: c93f22104a7b4a7caf0cc8b7180ffc55 Sep 20 04:58:23.179372 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Name: tempest-AttachVolumeNegativeTest-1482924724-project Sep 20 04:58:23.179372 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: method: > Sep 20 04:58:23.179372 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: exception: Instance 0f0fd5e7-f601-4fa1-870a-b2c497479260 could not be found. Sep 20 04:58:23.179372 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: action_args: {'id': '0f0fd5e7-f601-4fa1-870a-b2c497479260'} Sep 20 04:58:23.183693 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 04:58:23.183693 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:58:23.183693 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 04:58:23.183693 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 04:58:23.183693 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 04:58:23.183693 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 04:58:23.183693 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 04:58:23.183693 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 04:58:23.183693 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 04:58:23.183693 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 04:58:23.183693 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f0fd5e7-f601-4fa1-870a-b2c497479260 could not be found. Sep 20 04:58:23.183693 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:58:23.183693 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:58:23.183693 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:58:23.183693 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:58:23.183693 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:58:23.183693 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:58:23.183693 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 04:58:23.183693 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 04:58:23.183693 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 04:58:23.185527 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 04:58:23.185527 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 04:58:23.185527 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 04:58:23.185527 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 04:58:23.185527 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 04:58:23.185527 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 04:58:23.185527 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 04:58:23.185527 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f0fd5e7-f601-4fa1-870a-b2c497479260 could not be found. Sep 20 04:58:23.185527 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:58:23.185527 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:58:23.185527 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:58:23.185527 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:58:23.185527 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:58:23.185527 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:58:23.185527 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 04:58:23.185527 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 04:58:23.185527 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f0fd5e7-f601-4fa1-870a-b2c497479260 could not be found. Sep 20 04:58:23.185527 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:58:23.186983 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-1e89c5b9-69e8-4fc8-8bd0-3f4f8f07aad1 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Returning 404 to user: Instance 0f0fd5e7-f601-4fa1-870a-b2c497479260 could not be found. {{(pid=126813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 04:58:23.186983 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-1e89c5b9-69e8-4fc8-8bd0-3f4f8f07aad1 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/0f0fd5e7-f601-4fa1-870a-b2c497479260" status: 404 len: 111 microversion: 2.1 time: 0.031969 Sep 20 04:58:23.186983 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 405/555] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:58:23 2022] GET /compute/v2.1/servers/0f0fd5e7-f601-4fa1-870a-b2c497479260 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 20 04:58:23.187519 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-8c4bba53-6e41-4a66-8f60-b606a78bb2a5 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '.version_select at 0x7f2e4a4b0af0>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:58:23.207198 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-8c4bba53-6e41-4a66-8f60-b606a78bb2a5 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1821075672" status: 202 len: 0 microversion: 2.1 time: 0.023066 Sep 20 04:58:23.208036 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 406/556] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Sep 20 04:58:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1821075672 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 20 04:58:24.948580 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-0aac1917-66e0-44ed-a378-c263529e9294 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:58:24.949177 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-0aac1917-66e0-44ed-a378-c263529e9294 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 0f0fd5e7-f601-4fa1-870a-b2c497479260] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:58:24.958176 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0aac1917-66e0-44ed-a378-c263529e9294 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:24.958657 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0aac1917-66e0-44ed-a378-c263529e9294 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:24.959088 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0aac1917-66e0-44ed-a378-c263529e9294 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:24.959766 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0aac1917-66e0-44ed-a378-c263529e9294 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:24.960211 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0aac1917-66e0-44ed-a378-c263529e9294 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:24.960655 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0aac1917-66e0-44ed-a378-c263529e9294 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:24.973481 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.wsgi [None req-0aac1917-66e0-44ed-a378-c263529e9294 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] HTTP exception thrown: Instance 0f0fd5e7-f601-4fa1-870a-b2c497479260 could not be found. Sep 20 04:58:24.974981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-0aac1917-66e0-44ed-a378-c263529e9294 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Request method failure captured: Sep 20 04:58:24.974981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: request: DELETE /compute/v2.1/servers/0f0fd5e7-f601-4fa1-870a-b2c497479260 HTTP/1.1 Sep 20 04:58:24.974981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept: application/json Sep 20 04:58:24.974981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept-Encoding: identity Sep 20 04:58:24.974981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Connection: close Sep 20 04:58:24.974981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Length: 0 Sep 20 04:58:24.974981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Type: application/json Sep 20 04:58:24.974981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Host: 10.222.0.27 Sep 20 04:58:24.974981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Openstack-System-Scope: None Sep 20 04:58:24.974981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: User-Agent: python-urllib3/1.26.12 Sep 20 04:58:24.974981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Auth-Token: gAAAAABjKUbv3hCswc9OTl1x4i1QFI6XV3GUT2FYN7UTgjG9dzuM3jqx_GcwO4w0JWwRz9sTS2WwajnGfx2wJ2_1hAz4UUEc_snPtCtdpEIJJc5Fb8lrnltNsG7f_iYNiB6Uy9F1dOvGdMIHwFbxpPMJ6tdvqkqh2eaYhvMGxVgemwP0gnqQm2U Sep 20 04:58:24.974981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Id: None Sep 20 04:58:24.974981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Name: None Sep 20 04:58:24.974981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Identity-Status: Confirmed Sep 20 04:58:24.974981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Is-Admin-Project: True Sep 20 04:58:24.974981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Id: default Sep 20 04:58:24.974981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Name: Default Sep 20 04:58:24.974981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Id: 4f0f0b8842ae496292c27a6ee1350d32 Sep 20 04:58:24.974981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Name: tempest-AttachVolumeNegativeTest-1482924724 Sep 20 04:58:24.974981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Role: reader,member Sep 20 04:58:24.974981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Roles: reader,member Sep 20 04:58:24.976472 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f0f0b8842ae496292c27a6ee1350d32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f0f0b8842ae496292c27a6ee1350d32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4f0f0b8842ae496292c27a6ee1350d32", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4f0f0b8842ae496292c27a6ee1350d32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 04:58:24.976472 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant: tempest-AttachVolumeNegativeTest-1482924724 Sep 20 04:58:24.976472 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Id: 4f0f0b8842ae496292c27a6ee1350d32 Sep 20 04:58:24.976472 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1482924724 Sep 20 04:58:24.976472 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User: tempest-AttachVolumeNegativeTest-1482924724-project Sep 20 04:58:24.976472 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Id: default Sep 20 04:58:24.976472 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Name: Default Sep 20 04:58:24.976472 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Id: c93f22104a7b4a7caf0cc8b7180ffc55 Sep 20 04:58:24.976472 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Name: tempest-AttachVolumeNegativeTest-1482924724-project Sep 20 04:58:24.976472 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: method: > Sep 20 04:58:24.976472 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: exception: Instance 0f0fd5e7-f601-4fa1-870a-b2c497479260 could not be found. Sep 20 04:58:24.976472 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: action_args: {'id': '0f0fd5e7-f601-4fa1-870a-b2c497479260'} Sep 20 04:58:24.977352 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 04:58:24.977352 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:58:24.977352 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 04:58:24.977352 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 04:58:24.977352 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 04:58:24.977352 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 04:58:24.977352 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 04:58:24.977352 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 04:58:24.977352 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 04:58:24.977352 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 04:58:24.977352 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f0fd5e7-f601-4fa1-870a-b2c497479260 could not be found. Sep 20 04:58:24.977352 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:58:24.977352 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:58:24.977352 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:58:24.977352 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:58:24.977352 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:58:24.977352 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:58:24.977352 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 04:58:24.977352 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 04:58:24.977352 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 04:58:24.978724 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 04:58:24.978724 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 20 04:58:24.978724 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 20 04:58:24.978724 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 20 04:58:24.978724 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 20 04:58:24.978724 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 04:58:24.978724 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 04:58:24.978724 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 04:58:24.978724 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 04:58:24.978724 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f0fd5e7-f601-4fa1-870a-b2c497479260 could not be found. Sep 20 04:58:24.978724 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:58:24.978724 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:58:24.978724 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:58:24.978724 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:58:24.978724 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:58:24.978724 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:58:24.978724 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 04:58:24.978724 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 04:58:24.978724 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f0fd5e7-f601-4fa1-870a-b2c497479260 could not be found. Sep 20 04:58:24.978724 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:58:24.980239 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-0aac1917-66e0-44ed-a378-c263529e9294 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Returning 404 to user: Instance 0f0fd5e7-f601-4fa1-870a-b2c497479260 could not be found. {{(pid=126813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 04:58:24.980239 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-0aac1917-66e0-44ed-a378-c263529e9294 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0f0fd5e7-f601-4fa1-870a-b2c497479260" status: 404 len: 111 microversion: 2.1 time: 0.032206 Sep 20 04:58:24.980239 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 407/557] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Sep 20 04:58:24 2022] DELETE /compute/v2.1/servers/0f0fd5e7-f601-4fa1-870a-b2c497479260 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 20 04:58:24.984065 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-4d95b4b1-ca3d-4902-811e-e33d1ae01b25 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:58:24.984680 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-4d95b4b1-ca3d-4902-811e-e33d1ae01b25 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 0f0fd5e7-f601-4fa1-870a-b2c497479260] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:58:24.990133 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4d95b4b1-ca3d-4902-811e-e33d1ae01b25 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:24.990620 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4d95b4b1-ca3d-4902-811e-e33d1ae01b25 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:24.991035 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4d95b4b1-ca3d-4902-811e-e33d1ae01b25 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:24.991695 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4d95b4b1-ca3d-4902-811e-e33d1ae01b25 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:24.992142 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4d95b4b1-ca3d-4902-811e-e33d1ae01b25 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:24.992565 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4d95b4b1-ca3d-4902-811e-e33d1ae01b25 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:25.005677 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.wsgi [None req-4d95b4b1-ca3d-4902-811e-e33d1ae01b25 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] HTTP exception thrown: Instance 0f0fd5e7-f601-4fa1-870a-b2c497479260 could not be found. Sep 20 04:58:25.007123 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-4d95b4b1-ca3d-4902-811e-e33d1ae01b25 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Request method failure captured: Sep 20 04:58:25.007123 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: request: GET /compute/v2.1/servers/0f0fd5e7-f601-4fa1-870a-b2c497479260 HTTP/1.1 Sep 20 04:58:25.007123 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept: application/json Sep 20 04:58:25.007123 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept-Encoding: identity Sep 20 04:58:25.007123 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Connection: close Sep 20 04:58:25.007123 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Length: 0 Sep 20 04:58:25.007123 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Type: application/json Sep 20 04:58:25.007123 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Host: 10.222.0.27 Sep 20 04:58:25.007123 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Openstack-System-Scope: None Sep 20 04:58:25.007123 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: User-Agent: python-urllib3/1.26.12 Sep 20 04:58:25.007123 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Auth-Token: gAAAAABjKUbv3hCswc9OTl1x4i1QFI6XV3GUT2FYN7UTgjG9dzuM3jqx_GcwO4w0JWwRz9sTS2WwajnGfx2wJ2_1hAz4UUEc_snPtCtdpEIJJc5Fb8lrnltNsG7f_iYNiB6Uy9F1dOvGdMIHwFbxpPMJ6tdvqkqh2eaYhvMGxVgemwP0gnqQm2U Sep 20 04:58:25.007123 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Id: None Sep 20 04:58:25.007123 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Name: None Sep 20 04:58:25.007123 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Identity-Status: Confirmed Sep 20 04:58:25.007123 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Is-Admin-Project: True Sep 20 04:58:25.007123 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Id: default Sep 20 04:58:25.007123 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Name: Default Sep 20 04:58:25.007123 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Id: 4f0f0b8842ae496292c27a6ee1350d32 Sep 20 04:58:25.007123 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Name: tempest-AttachVolumeNegativeTest-1482924724 Sep 20 04:58:25.007123 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Role: reader,member Sep 20 04:58:25.007123 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Roles: reader,member Sep 20 04:58:25.008589 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f0f0b8842ae496292c27a6ee1350d32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f0f0b8842ae496292c27a6ee1350d32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4f0f0b8842ae496292c27a6ee1350d32", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4f0f0b8842ae496292c27a6ee1350d32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 04:58:25.008589 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant: tempest-AttachVolumeNegativeTest-1482924724 Sep 20 04:58:25.008589 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Id: 4f0f0b8842ae496292c27a6ee1350d32 Sep 20 04:58:25.008589 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1482924724 Sep 20 04:58:25.008589 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User: tempest-AttachVolumeNegativeTest-1482924724-project Sep 20 04:58:25.008589 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Id: default Sep 20 04:58:25.008589 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Name: Default Sep 20 04:58:25.008589 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Id: c93f22104a7b4a7caf0cc8b7180ffc55 Sep 20 04:58:25.008589 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Name: tempest-AttachVolumeNegativeTest-1482924724-project Sep 20 04:58:25.008589 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: method: > Sep 20 04:58:25.008589 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: exception: Instance 0f0fd5e7-f601-4fa1-870a-b2c497479260 could not be found. Sep 20 04:58:25.008589 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: action_args: {'id': '0f0fd5e7-f601-4fa1-870a-b2c497479260'} Sep 20 04:58:25.009981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 04:58:25.009981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:58:25.009981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 04:58:25.009981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 04:58:25.009981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 04:58:25.009981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 04:58:25.009981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 04:58:25.009981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 04:58:25.009981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 04:58:25.009981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 04:58:25.009981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f0fd5e7-f601-4fa1-870a-b2c497479260 could not be found. Sep 20 04:58:25.009981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:58:25.009981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:58:25.009981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:58:25.009981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:58:25.009981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:58:25.009981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:58:25.009981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 04:58:25.009981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 04:58:25.009981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 04:58:25.011349 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 04:58:25.011349 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 04:58:25.011349 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 04:58:25.011349 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 04:58:25.011349 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 04:58:25.011349 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 04:58:25.011349 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 04:58:25.011349 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f0fd5e7-f601-4fa1-870a-b2c497479260 could not be found. Sep 20 04:58:25.011349 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:58:25.011349 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:58:25.011349 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:58:25.011349 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:58:25.011349 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:58:25.011349 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:58:25.011349 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 04:58:25.011349 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 04:58:25.011349 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f0fd5e7-f601-4fa1-870a-b2c497479260 could not be found. Sep 20 04:58:25.011349 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:58:25.012544 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-4d95b4b1-ca3d-4902-811e-e33d1ae01b25 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Returning 404 to user: Instance 0f0fd5e7-f601-4fa1-870a-b2c497479260 could not be found. {{(pid=126813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 04:58:25.012544 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-4d95b4b1-ca3d-4902-811e-e33d1ae01b25 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/0f0fd5e7-f601-4fa1-870a-b2c497479260" status: 404 len: 111 microversion: 2.1 time: 0.027780 Sep 20 04:58:25.012544 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 408/558] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:58:24 2022] GET /compute/v2.1/servers/0f0fd5e7-f601-4fa1-870a-b2c497479260 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 20 04:58:26.145235 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-6acd1d2d-ff6c-4a3a-bbad-89cd917be30e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:58:26.145834 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-6acd1d2d-ff6c-4a3a-bbad-89cd917be30e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 08dd20c3-27f2-4e1a-b083-c17cb2171a16] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:58:26.152905 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6acd1d2d-ff6c-4a3a-bbad-89cd917be30e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:26.153445 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6acd1d2d-ff6c-4a3a-bbad-89cd917be30e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:26.153870 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6acd1d2d-ff6c-4a3a-bbad-89cd917be30e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:26.154599 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6acd1d2d-ff6c-4a3a-bbad-89cd917be30e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:26.155082 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6acd1d2d-ff6c-4a3a-bbad-89cd917be30e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:26.155505 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6acd1d2d-ff6c-4a3a-bbad-89cd917be30e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:26.169152 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.wsgi [None req-6acd1d2d-ff6c-4a3a-bbad-89cd917be30e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] HTTP exception thrown: Instance 08dd20c3-27f2-4e1a-b083-c17cb2171a16 could not be found. Sep 20 04:58:26.170688 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-6acd1d2d-ff6c-4a3a-bbad-89cd917be30e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Request method failure captured: Sep 20 04:58:26.170688 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: request: DELETE /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16 HTTP/1.1 Sep 20 04:58:26.170688 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept: application/json Sep 20 04:58:26.170688 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept-Encoding: identity Sep 20 04:58:26.170688 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Connection: close Sep 20 04:58:26.170688 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Length: 0 Sep 20 04:58:26.170688 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Type: application/json Sep 20 04:58:26.170688 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Host: 10.222.0.27 Sep 20 04:58:26.170688 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Openstack-System-Scope: None Sep 20 04:58:26.170688 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: User-Agent: python-urllib3/1.26.12 Sep 20 04:58:26.170688 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Auth-Token: gAAAAABjKUbv3hCswc9OTl1x4i1QFI6XV3GUT2FYN7UTgjG9dzuM3jqx_GcwO4w0JWwRz9sTS2WwajnGfx2wJ2_1hAz4UUEc_snPtCtdpEIJJc5Fb8lrnltNsG7f_iYNiB6Uy9F1dOvGdMIHwFbxpPMJ6tdvqkqh2eaYhvMGxVgemwP0gnqQm2U Sep 20 04:58:26.170688 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Id: None Sep 20 04:58:26.170688 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Name: None Sep 20 04:58:26.170688 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Identity-Status: Confirmed Sep 20 04:58:26.170688 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Is-Admin-Project: True Sep 20 04:58:26.170688 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Id: default Sep 20 04:58:26.170688 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Name: Default Sep 20 04:58:26.170688 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Id: 4f0f0b8842ae496292c27a6ee1350d32 Sep 20 04:58:26.170688 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Name: tempest-AttachVolumeNegativeTest-1482924724 Sep 20 04:58:26.170688 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Role: reader,member Sep 20 04:58:26.170688 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Roles: reader,member Sep 20 04:58:26.172333 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f0f0b8842ae496292c27a6ee1350d32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f0f0b8842ae496292c27a6ee1350d32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4f0f0b8842ae496292c27a6ee1350d32", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4f0f0b8842ae496292c27a6ee1350d32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 04:58:26.172333 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant: tempest-AttachVolumeNegativeTest-1482924724 Sep 20 04:58:26.172333 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Id: 4f0f0b8842ae496292c27a6ee1350d32 Sep 20 04:58:26.172333 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1482924724 Sep 20 04:58:26.172333 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User: tempest-AttachVolumeNegativeTest-1482924724-project Sep 20 04:58:26.172333 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Id: default Sep 20 04:58:26.172333 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Name: Default Sep 20 04:58:26.172333 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Id: c93f22104a7b4a7caf0cc8b7180ffc55 Sep 20 04:58:26.172333 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Name: tempest-AttachVolumeNegativeTest-1482924724-project Sep 20 04:58:26.172333 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: method: > Sep 20 04:58:26.172333 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: exception: Instance 08dd20c3-27f2-4e1a-b083-c17cb2171a16 could not be found. Sep 20 04:58:26.172333 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: action_args: {'id': '08dd20c3-27f2-4e1a-b083-c17cb2171a16'} Sep 20 04:58:26.173195 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 04:58:26.173195 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:58:26.173195 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 04:58:26.173195 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 04:58:26.173195 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 04:58:26.173195 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 04:58:26.173195 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 04:58:26.173195 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 04:58:26.173195 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 04:58:26.173195 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 04:58:26.173195 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08dd20c3-27f2-4e1a-b083-c17cb2171a16 could not be found. Sep 20 04:58:26.173195 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:58:26.173195 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:58:26.173195 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:58:26.173195 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:58:26.173195 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:58:26.173195 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:58:26.173195 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 04:58:26.173195 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 04:58:26.173195 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 04:58:26.174470 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 04:58:26.174470 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 20 04:58:26.174470 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 20 04:58:26.174470 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 20 04:58:26.174470 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 20 04:58:26.174470 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 04:58:26.174470 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 04:58:26.174470 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 04:58:26.174470 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 04:58:26.174470 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08dd20c3-27f2-4e1a-b083-c17cb2171a16 could not be found. Sep 20 04:58:26.174470 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:58:26.174470 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:58:26.174470 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:58:26.174470 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:58:26.174470 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:58:26.174470 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:58:26.174470 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 04:58:26.174470 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 04:58:26.174470 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08dd20c3-27f2-4e1a-b083-c17cb2171a16 could not be found. Sep 20 04:58:26.174470 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:58:26.175718 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-6acd1d2d-ff6c-4a3a-bbad-89cd917be30e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Returning 404 to user: Instance 08dd20c3-27f2-4e1a-b083-c17cb2171a16 could not be found. {{(pid=126813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 04:58:26.175718 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-6acd1d2d-ff6c-4a3a-bbad-89cd917be30e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "DELETE /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16" status: 404 len: 111 microversion: 2.1 time: 0.030677 Sep 20 04:58:26.175718 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 409/559] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Sep 20 04:58:26 2022] DELETE /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 20 04:58:26.179923 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-7bc354c3-cd69-45e6-943a-46bfa4c2c12e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:58:26.180529 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-7bc354c3-cd69-45e6-943a-46bfa4c2c12e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 08dd20c3-27f2-4e1a-b083-c17cb2171a16] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:58:26.186145 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7bc354c3-cd69-45e6-943a-46bfa4c2c12e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:26.186619 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7bc354c3-cd69-45e6-943a-46bfa4c2c12e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:26.187053 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7bc354c3-cd69-45e6-943a-46bfa4c2c12e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:26.187727 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7bc354c3-cd69-45e6-943a-46bfa4c2c12e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:26.188177 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7bc354c3-cd69-45e6-943a-46bfa4c2c12e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:26.188626 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7bc354c3-cd69-45e6-943a-46bfa4c2c12e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:26.202018 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.wsgi [None req-7bc354c3-cd69-45e6-943a-46bfa4c2c12e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] HTTP exception thrown: Instance 08dd20c3-27f2-4e1a-b083-c17cb2171a16 could not be found. Sep 20 04:58:26.203495 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-7bc354c3-cd69-45e6-943a-46bfa4c2c12e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Request method failure captured: Sep 20 04:58:26.203495 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: request: GET /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16 HTTP/1.1 Sep 20 04:58:26.203495 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept: application/json Sep 20 04:58:26.203495 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept-Encoding: identity Sep 20 04:58:26.203495 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Connection: close Sep 20 04:58:26.203495 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Length: 0 Sep 20 04:58:26.203495 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Type: application/json Sep 20 04:58:26.203495 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Host: 10.222.0.27 Sep 20 04:58:26.203495 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Openstack-System-Scope: None Sep 20 04:58:26.203495 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: User-Agent: python-urllib3/1.26.12 Sep 20 04:58:26.203495 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Auth-Token: gAAAAABjKUbv3hCswc9OTl1x4i1QFI6XV3GUT2FYN7UTgjG9dzuM3jqx_GcwO4w0JWwRz9sTS2WwajnGfx2wJ2_1hAz4UUEc_snPtCtdpEIJJc5Fb8lrnltNsG7f_iYNiB6Uy9F1dOvGdMIHwFbxpPMJ6tdvqkqh2eaYhvMGxVgemwP0gnqQm2U Sep 20 04:58:26.203495 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Id: None Sep 20 04:58:26.203495 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Name: None Sep 20 04:58:26.203495 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Identity-Status: Confirmed Sep 20 04:58:26.203495 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Is-Admin-Project: True Sep 20 04:58:26.203495 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Id: default Sep 20 04:58:26.203495 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Name: Default Sep 20 04:58:26.203495 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Id: 4f0f0b8842ae496292c27a6ee1350d32 Sep 20 04:58:26.203495 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Name: tempest-AttachVolumeNegativeTest-1482924724 Sep 20 04:58:26.203495 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Role: reader,member Sep 20 04:58:26.203495 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Roles: reader,member Sep 20 04:58:26.205032 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f0f0b8842ae496292c27a6ee1350d32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f0f0b8842ae496292c27a6ee1350d32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4f0f0b8842ae496292c27a6ee1350d32", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4f0f0b8842ae496292c27a6ee1350d32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 04:58:26.205032 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant: tempest-AttachVolumeNegativeTest-1482924724 Sep 20 04:58:26.205032 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Id: 4f0f0b8842ae496292c27a6ee1350d32 Sep 20 04:58:26.205032 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1482924724 Sep 20 04:58:26.205032 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User: tempest-AttachVolumeNegativeTest-1482924724-project Sep 20 04:58:26.205032 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Id: default Sep 20 04:58:26.205032 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Name: Default Sep 20 04:58:26.205032 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Id: c93f22104a7b4a7caf0cc8b7180ffc55 Sep 20 04:58:26.205032 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Name: tempest-AttachVolumeNegativeTest-1482924724-project Sep 20 04:58:26.205032 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: method: > Sep 20 04:58:26.205032 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: exception: Instance 08dd20c3-27f2-4e1a-b083-c17cb2171a16 could not be found. Sep 20 04:58:26.205032 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: action_args: {'id': '08dd20c3-27f2-4e1a-b083-c17cb2171a16'} Sep 20 04:58:26.205963 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 04:58:26.205963 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:58:26.205963 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 04:58:26.205963 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 04:58:26.205963 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 04:58:26.205963 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 04:58:26.205963 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 04:58:26.205963 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 04:58:26.205963 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 04:58:26.205963 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 04:58:26.205963 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08dd20c3-27f2-4e1a-b083-c17cb2171a16 could not be found. Sep 20 04:58:26.205963 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:58:26.205963 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:58:26.205963 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:58:26.205963 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:58:26.205963 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:58:26.205963 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:58:26.205963 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 04:58:26.205963 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 04:58:26.205963 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 04:58:26.207140 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 04:58:26.207140 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 04:58:26.207140 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 04:58:26.207140 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 04:58:26.207140 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 04:58:26.207140 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 04:58:26.207140 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 04:58:26.207140 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08dd20c3-27f2-4e1a-b083-c17cb2171a16 could not be found. Sep 20 04:58:26.207140 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:58:26.207140 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:58:26.207140 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:58:26.207140 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:58:26.207140 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:58:26.207140 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:58:26.207140 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 04:58:26.207140 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 04:58:26.207140 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08dd20c3-27f2-4e1a-b083-c17cb2171a16 could not be found. Sep 20 04:58:26.207140 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:58:26.208171 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-7bc354c3-cd69-45e6-943a-46bfa4c2c12e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Returning 404 to user: Instance 08dd20c3-27f2-4e1a-b083-c17cb2171a16 could not be found. {{(pid=126813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 04:58:26.208171 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-7bc354c3-cd69-45e6-943a-46bfa4c2c12e tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16" status: 404 len: 111 microversion: 2.1 time: 0.028386 Sep 20 04:58:26.208171 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 410/560] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:58:26 2022] GET /compute/v2.1/servers/08dd20c3-27f2-4e1a-b083-c17cb2171a16 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 20 04:58:26.213013 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-7501c59d-33a1-4e6d-b5d0-99d7a7af45dd tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:58:26.213492 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-7501c59d-33a1-4e6d-b5d0-99d7a7af45dd tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 60372fad-5a9d-4d04-89e4-8aca10601222] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:58:26.218952 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7501c59d-33a1-4e6d-b5d0-99d7a7af45dd tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:26.219426 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7501c59d-33a1-4e6d-b5d0-99d7a7af45dd tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:26.219893 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7501c59d-33a1-4e6d-b5d0-99d7a7af45dd tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:26.220533 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7501c59d-33a1-4e6d-b5d0-99d7a7af45dd tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:26.221092 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7501c59d-33a1-4e6d-b5d0-99d7a7af45dd tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:26.221521 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7501c59d-33a1-4e6d-b5d0-99d7a7af45dd tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:26.234397 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.wsgi [None req-7501c59d-33a1-4e6d-b5d0-99d7a7af45dd tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] HTTP exception thrown: Instance 60372fad-5a9d-4d04-89e4-8aca10601222 could not be found. Sep 20 04:58:26.235955 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-7501c59d-33a1-4e6d-b5d0-99d7a7af45dd tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Request method failure captured: Sep 20 04:58:26.235955 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: request: DELETE /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222 HTTP/1.1 Sep 20 04:58:26.235955 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept: application/json Sep 20 04:58:26.235955 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept-Encoding: identity Sep 20 04:58:26.235955 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Connection: close Sep 20 04:58:26.235955 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Length: 0 Sep 20 04:58:26.235955 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Type: application/json Sep 20 04:58:26.235955 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Host: 10.222.0.27 Sep 20 04:58:26.235955 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Openstack-System-Scope: None Sep 20 04:58:26.235955 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: User-Agent: python-urllib3/1.26.12 Sep 20 04:58:26.235955 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Auth-Token: gAAAAABjKUbv3hCswc9OTl1x4i1QFI6XV3GUT2FYN7UTgjG9dzuM3jqx_GcwO4w0JWwRz9sTS2WwajnGfx2wJ2_1hAz4UUEc_snPtCtdpEIJJc5Fb8lrnltNsG7f_iYNiB6Uy9F1dOvGdMIHwFbxpPMJ6tdvqkqh2eaYhvMGxVgemwP0gnqQm2U Sep 20 04:58:26.235955 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Id: None Sep 20 04:58:26.235955 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Name: None Sep 20 04:58:26.235955 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Identity-Status: Confirmed Sep 20 04:58:26.235955 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Is-Admin-Project: True Sep 20 04:58:26.235955 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Id: default Sep 20 04:58:26.235955 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Name: Default Sep 20 04:58:26.235955 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Id: 4f0f0b8842ae496292c27a6ee1350d32 Sep 20 04:58:26.235955 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Name: tempest-AttachVolumeNegativeTest-1482924724 Sep 20 04:58:26.235955 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Role: reader,member Sep 20 04:58:26.235955 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Roles: reader,member Sep 20 04:58:26.237468 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f0f0b8842ae496292c27a6ee1350d32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f0f0b8842ae496292c27a6ee1350d32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4f0f0b8842ae496292c27a6ee1350d32", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4f0f0b8842ae496292c27a6ee1350d32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 04:58:26.237468 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant: tempest-AttachVolumeNegativeTest-1482924724 Sep 20 04:58:26.237468 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Id: 4f0f0b8842ae496292c27a6ee1350d32 Sep 20 04:58:26.237468 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1482924724 Sep 20 04:58:26.237468 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User: tempest-AttachVolumeNegativeTest-1482924724-project Sep 20 04:58:26.237468 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Id: default Sep 20 04:58:26.237468 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Name: Default Sep 20 04:58:26.237468 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Id: c93f22104a7b4a7caf0cc8b7180ffc55 Sep 20 04:58:26.237468 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Name: tempest-AttachVolumeNegativeTest-1482924724-project Sep 20 04:58:26.237468 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: method: > Sep 20 04:58:26.237468 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: exception: Instance 60372fad-5a9d-4d04-89e4-8aca10601222 could not be found. Sep 20 04:58:26.237468 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: action_args: {'id': '60372fad-5a9d-4d04-89e4-8aca10601222'} Sep 20 04:58:26.238336 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 04:58:26.238336 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:58:26.238336 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 04:58:26.238336 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 04:58:26.238336 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 04:58:26.238336 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 04:58:26.238336 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 04:58:26.238336 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 04:58:26.238336 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 04:58:26.238336 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 04:58:26.238336 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60372fad-5a9d-4d04-89e4-8aca10601222 could not be found. Sep 20 04:58:26.238336 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:58:26.238336 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:58:26.238336 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:58:26.238336 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:58:26.238336 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:58:26.238336 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:58:26.238336 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 04:58:26.238336 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 04:58:26.238336 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 04:58:26.239722 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 04:58:26.239722 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 20 04:58:26.239722 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 20 04:58:26.239722 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 20 04:58:26.239722 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 20 04:58:26.239722 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 04:58:26.239722 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 04:58:26.239722 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 04:58:26.239722 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 04:58:26.239722 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60372fad-5a9d-4d04-89e4-8aca10601222 could not be found. Sep 20 04:58:26.239722 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:58:26.239722 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:58:26.239722 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:58:26.239722 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:58:26.239722 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:58:26.239722 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:58:26.239722 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 04:58:26.239722 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 04:58:26.239722 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60372fad-5a9d-4d04-89e4-8aca10601222 could not be found. Sep 20 04:58:26.239722 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:58:26.241437 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-7501c59d-33a1-4e6d-b5d0-99d7a7af45dd tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Returning 404 to user: Instance 60372fad-5a9d-4d04-89e4-8aca10601222 could not be found. {{(pid=126813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 04:58:26.241437 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-7501c59d-33a1-4e6d-b5d0-99d7a7af45dd tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "DELETE /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222" status: 404 len: 111 microversion: 2.1 time: 0.028342 Sep 20 04:58:26.241437 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 411/561] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Sep 20 04:58:26 2022] DELETE /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 20 04:58:26.245334 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-8882fd34-729d-4417-98c1-b279b6cb46d0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:58:26.245932 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-8882fd34-729d-4417-98c1-b279b6cb46d0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 60372fad-5a9d-4d04-89e4-8aca10601222] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:58:26.251404 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8882fd34-729d-4417-98c1-b279b6cb46d0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:26.251876 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8882fd34-729d-4417-98c1-b279b6cb46d0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:26.252312 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8882fd34-729d-4417-98c1-b279b6cb46d0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:26.253019 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8882fd34-729d-4417-98c1-b279b6cb46d0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:26.253471 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8882fd34-729d-4417-98c1-b279b6cb46d0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:26.253894 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8882fd34-729d-4417-98c1-b279b6cb46d0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:26.267686 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.wsgi [None req-8882fd34-729d-4417-98c1-b279b6cb46d0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] HTTP exception thrown: Instance 60372fad-5a9d-4d04-89e4-8aca10601222 could not be found. Sep 20 04:58:26.269198 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-8882fd34-729d-4417-98c1-b279b6cb46d0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Request method failure captured: Sep 20 04:58:26.269198 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: request: GET /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222 HTTP/1.1 Sep 20 04:58:26.269198 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept: application/json Sep 20 04:58:26.269198 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept-Encoding: identity Sep 20 04:58:26.269198 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Connection: close Sep 20 04:58:26.269198 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Length: 0 Sep 20 04:58:26.269198 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Type: application/json Sep 20 04:58:26.269198 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Host: 10.222.0.27 Sep 20 04:58:26.269198 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Openstack-System-Scope: None Sep 20 04:58:26.269198 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: User-Agent: python-urllib3/1.26.12 Sep 20 04:58:26.269198 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Auth-Token: gAAAAABjKUbv3hCswc9OTl1x4i1QFI6XV3GUT2FYN7UTgjG9dzuM3jqx_GcwO4w0JWwRz9sTS2WwajnGfx2wJ2_1hAz4UUEc_snPtCtdpEIJJc5Fb8lrnltNsG7f_iYNiB6Uy9F1dOvGdMIHwFbxpPMJ6tdvqkqh2eaYhvMGxVgemwP0gnqQm2U Sep 20 04:58:26.269198 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Id: None Sep 20 04:58:26.269198 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Name: None Sep 20 04:58:26.269198 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Identity-Status: Confirmed Sep 20 04:58:26.269198 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Is-Admin-Project: True Sep 20 04:58:26.269198 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Id: default Sep 20 04:58:26.269198 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Name: Default Sep 20 04:58:26.269198 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Id: 4f0f0b8842ae496292c27a6ee1350d32 Sep 20 04:58:26.269198 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Name: tempest-AttachVolumeNegativeTest-1482924724 Sep 20 04:58:26.269198 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Role: reader,member Sep 20 04:58:26.269198 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Roles: reader,member Sep 20 04:58:26.270726 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f0f0b8842ae496292c27a6ee1350d32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f0f0b8842ae496292c27a6ee1350d32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4f0f0b8842ae496292c27a6ee1350d32", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4f0f0b8842ae496292c27a6ee1350d32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 04:58:26.270726 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant: tempest-AttachVolumeNegativeTest-1482924724 Sep 20 04:58:26.270726 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Id: 4f0f0b8842ae496292c27a6ee1350d32 Sep 20 04:58:26.270726 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1482924724 Sep 20 04:58:26.270726 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User: tempest-AttachVolumeNegativeTest-1482924724-project Sep 20 04:58:26.270726 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Id: default Sep 20 04:58:26.270726 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Name: Default Sep 20 04:58:26.270726 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Id: c93f22104a7b4a7caf0cc8b7180ffc55 Sep 20 04:58:26.270726 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Name: tempest-AttachVolumeNegativeTest-1482924724-project Sep 20 04:58:26.270726 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: method: > Sep 20 04:58:26.270726 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: exception: Instance 60372fad-5a9d-4d04-89e4-8aca10601222 could not be found. Sep 20 04:58:26.270726 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: action_args: {'id': '60372fad-5a9d-4d04-89e4-8aca10601222'} Sep 20 04:58:26.271526 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 04:58:26.271526 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:58:26.271526 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 04:58:26.271526 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 04:58:26.271526 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 04:58:26.271526 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 04:58:26.271526 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 04:58:26.271526 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 04:58:26.271526 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 04:58:26.271526 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 04:58:26.271526 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60372fad-5a9d-4d04-89e4-8aca10601222 could not be found. Sep 20 04:58:26.271526 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:58:26.271526 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:58:26.271526 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:58:26.271526 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:58:26.271526 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:58:26.271526 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:58:26.271526 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 04:58:26.271526 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 04:58:26.271526 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 04:58:26.272830 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 04:58:26.272830 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 04:58:26.272830 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 04:58:26.272830 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 04:58:26.272830 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 04:58:26.272830 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 04:58:26.272830 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 04:58:26.272830 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60372fad-5a9d-4d04-89e4-8aca10601222 could not be found. Sep 20 04:58:26.272830 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:58:26.272830 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:58:26.272830 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:58:26.272830 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:58:26.272830 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:58:26.272830 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:58:26.272830 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 04:58:26.272830 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 04:58:26.272830 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60372fad-5a9d-4d04-89e4-8aca10601222 could not be found. Sep 20 04:58:26.272830 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:58:26.273896 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-8882fd34-729d-4417-98c1-b279b6cb46d0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Returning 404 to user: Instance 60372fad-5a9d-4d04-89e4-8aca10601222 could not be found. {{(pid=126813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 04:58:26.273896 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-8882fd34-729d-4417-98c1-b279b6cb46d0 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222" status: 404 len: 111 microversion: 2.1 time: 0.029058 Sep 20 04:58:26.273896 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 412/562] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:58:26 2022] GET /compute/v2.1/servers/60372fad-5a9d-4d04-89e4-8aca10601222 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 20 04:58:27.405333 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-90e4649f-1991-4009-ae91-86703eefa947 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:58:27.405910 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-90e4649f-1991-4009-ae91-86703eefa947 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:58:27.412215 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-90e4649f-1991-4009-ae91-86703eefa947 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:27.412778 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-90e4649f-1991-4009-ae91-86703eefa947 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:27.413232 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-90e4649f-1991-4009-ae91-86703eefa947 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:27.414103 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-90e4649f-1991-4009-ae91-86703eefa947 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:27.414550 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-90e4649f-1991-4009-ae91-86703eefa947 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:27.415464 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-90e4649f-1991-4009-ae91-86703eefa947 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:27.428512 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.wsgi [None req-90e4649f-1991-4009-ae91-86703eefa947 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] HTTP exception thrown: Instance 7723784c-51e5-4936-b33a-caf9b1b87bab could not be found. Sep 20 04:58:27.430078 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-90e4649f-1991-4009-ae91-86703eefa947 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Request method failure captured: Sep 20 04:58:27.430078 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: request: DELETE /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab HTTP/1.1 Sep 20 04:58:27.430078 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept: application/json Sep 20 04:58:27.430078 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept-Encoding: identity Sep 20 04:58:27.430078 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Connection: close Sep 20 04:58:27.430078 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Length: 0 Sep 20 04:58:27.430078 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Type: application/json Sep 20 04:58:27.430078 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Host: 10.222.0.27 Sep 20 04:58:27.430078 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Openstack-System-Scope: None Sep 20 04:58:27.430078 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: User-Agent: python-urllib3/1.26.12 Sep 20 04:58:27.430078 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Auth-Token: gAAAAABjKUbv3hCswc9OTl1x4i1QFI6XV3GUT2FYN7UTgjG9dzuM3jqx_GcwO4w0JWwRz9sTS2WwajnGfx2wJ2_1hAz4UUEc_snPtCtdpEIJJc5Fb8lrnltNsG7f_iYNiB6Uy9F1dOvGdMIHwFbxpPMJ6tdvqkqh2eaYhvMGxVgemwP0gnqQm2U Sep 20 04:58:27.430078 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Id: None Sep 20 04:58:27.430078 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Name: None Sep 20 04:58:27.430078 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Identity-Status: Confirmed Sep 20 04:58:27.430078 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Is-Admin-Project: True Sep 20 04:58:27.430078 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Id: default Sep 20 04:58:27.430078 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Name: Default Sep 20 04:58:27.430078 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Id: 4f0f0b8842ae496292c27a6ee1350d32 Sep 20 04:58:27.430078 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Name: tempest-AttachVolumeNegativeTest-1482924724 Sep 20 04:58:27.430078 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Role: reader,member Sep 20 04:58:27.430078 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Roles: reader,member Sep 20 04:58:27.432352 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f0f0b8842ae496292c27a6ee1350d32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f0f0b8842ae496292c27a6ee1350d32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4f0f0b8842ae496292c27a6ee1350d32", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4f0f0b8842ae496292c27a6ee1350d32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 04:58:27.432352 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant: tempest-AttachVolumeNegativeTest-1482924724 Sep 20 04:58:27.432352 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Id: 4f0f0b8842ae496292c27a6ee1350d32 Sep 20 04:58:27.432352 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1482924724 Sep 20 04:58:27.432352 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User: tempest-AttachVolumeNegativeTest-1482924724-project Sep 20 04:58:27.432352 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Id: default Sep 20 04:58:27.432352 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Name: Default Sep 20 04:58:27.432352 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Id: c93f22104a7b4a7caf0cc8b7180ffc55 Sep 20 04:58:27.432352 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Name: tempest-AttachVolumeNegativeTest-1482924724-project Sep 20 04:58:27.432352 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: method: > Sep 20 04:58:27.432352 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: exception: Instance 7723784c-51e5-4936-b33a-caf9b1b87bab could not be found. Sep 20 04:58:27.432352 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: action_args: {'id': '7723784c-51e5-4936-b33a-caf9b1b87bab'} Sep 20 04:58:27.433265 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 04:58:27.433265 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:58:27.433265 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 04:58:27.433265 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 04:58:27.433265 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 04:58:27.433265 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 04:58:27.433265 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 04:58:27.433265 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 04:58:27.433265 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 04:58:27.433265 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 04:58:27.433265 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7723784c-51e5-4936-b33a-caf9b1b87bab could not be found. Sep 20 04:58:27.433265 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:58:27.433265 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:58:27.433265 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:58:27.433265 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:58:27.433265 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:58:27.433265 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:58:27.433265 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 04:58:27.433265 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 04:58:27.433265 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 04:58:27.434706 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 04:58:27.434706 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 20 04:58:27.434706 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 20 04:58:27.434706 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 20 04:58:27.434706 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 20 04:58:27.434706 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 04:58:27.434706 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 04:58:27.434706 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 04:58:27.434706 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 04:58:27.434706 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7723784c-51e5-4936-b33a-caf9b1b87bab could not be found. Sep 20 04:58:27.434706 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:58:27.434706 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:58:27.434706 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:58:27.434706 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:58:27.434706 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:58:27.434706 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:58:27.434706 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 04:58:27.434706 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 04:58:27.434706 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7723784c-51e5-4936-b33a-caf9b1b87bab could not be found. Sep 20 04:58:27.434706 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:58:27.436390 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-90e4649f-1991-4009-ae91-86703eefa947 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Returning 404 to user: Instance 7723784c-51e5-4936-b33a-caf9b1b87bab could not be found. {{(pid=126813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 04:58:27.436390 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-90e4649f-1991-4009-ae91-86703eefa947 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab" status: 404 len: 111 microversion: 2.1 time: 0.030476 Sep 20 04:58:27.436390 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 413/563] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Sep 20 04:58:27 2022] DELETE /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 20 04:58:27.439842 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-e28165fc-6e92-465f-9528-652fd7583c61 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:58:27.440447 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-e28165fc-6e92-465f-9528-652fd7583c61 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] [instance: 7723784c-51e5-4936-b33a-caf9b1b87bab] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:58:27.445964 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e28165fc-6e92-465f-9528-652fd7583c61 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:27.446601 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e28165fc-6e92-465f-9528-652fd7583c61 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:27.447212 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e28165fc-6e92-465f-9528-652fd7583c61 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:27.447882 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e28165fc-6e92-465f-9528-652fd7583c61 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:27.448329 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e28165fc-6e92-465f-9528-652fd7583c61 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:27.448779 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e28165fc-6e92-465f-9528-652fd7583c61 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:27.462229 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.wsgi [None req-e28165fc-6e92-465f-9528-652fd7583c61 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] HTTP exception thrown: Instance 7723784c-51e5-4936-b33a-caf9b1b87bab could not be found. Sep 20 04:58:27.463696 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-e28165fc-6e92-465f-9528-652fd7583c61 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Request method failure captured: Sep 20 04:58:27.463696 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: request: GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab HTTP/1.1 Sep 20 04:58:27.463696 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept: application/json Sep 20 04:58:27.463696 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept-Encoding: identity Sep 20 04:58:27.463696 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Connection: close Sep 20 04:58:27.463696 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Length: 0 Sep 20 04:58:27.463696 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Type: application/json Sep 20 04:58:27.463696 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Host: 10.222.0.27 Sep 20 04:58:27.463696 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Openstack-System-Scope: None Sep 20 04:58:27.463696 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: User-Agent: python-urllib3/1.26.12 Sep 20 04:58:27.463696 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Auth-Token: gAAAAABjKUbv3hCswc9OTl1x4i1QFI6XV3GUT2FYN7UTgjG9dzuM3jqx_GcwO4w0JWwRz9sTS2WwajnGfx2wJ2_1hAz4UUEc_snPtCtdpEIJJc5Fb8lrnltNsG7f_iYNiB6Uy9F1dOvGdMIHwFbxpPMJ6tdvqkqh2eaYhvMGxVgemwP0gnqQm2U Sep 20 04:58:27.463696 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Id: None Sep 20 04:58:27.463696 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Name: None Sep 20 04:58:27.463696 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Identity-Status: Confirmed Sep 20 04:58:27.463696 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Is-Admin-Project: True Sep 20 04:58:27.463696 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Id: default Sep 20 04:58:27.463696 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Name: Default Sep 20 04:58:27.463696 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Id: 4f0f0b8842ae496292c27a6ee1350d32 Sep 20 04:58:27.463696 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Name: tempest-AttachVolumeNegativeTest-1482924724 Sep 20 04:58:27.463696 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Role: reader,member Sep 20 04:58:27.463696 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Roles: reader,member Sep 20 04:58:27.465263 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f0f0b8842ae496292c27a6ee1350d32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f0f0b8842ae496292c27a6ee1350d32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4f0f0b8842ae496292c27a6ee1350d32", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4f0f0b8842ae496292c27a6ee1350d32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 04:58:27.465263 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant: tempest-AttachVolumeNegativeTest-1482924724 Sep 20 04:58:27.465263 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Id: 4f0f0b8842ae496292c27a6ee1350d32 Sep 20 04:58:27.465263 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1482924724 Sep 20 04:58:27.465263 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User: tempest-AttachVolumeNegativeTest-1482924724-project Sep 20 04:58:27.465263 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Id: default Sep 20 04:58:27.465263 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Name: Default Sep 20 04:58:27.465263 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Id: c93f22104a7b4a7caf0cc8b7180ffc55 Sep 20 04:58:27.465263 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Name: tempest-AttachVolumeNegativeTest-1482924724-project Sep 20 04:58:27.465263 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: method: > Sep 20 04:58:27.465263 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: exception: Instance 7723784c-51e5-4936-b33a-caf9b1b87bab could not be found. Sep 20 04:58:27.465263 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: action_args: {'id': '7723784c-51e5-4936-b33a-caf9b1b87bab'} Sep 20 04:58:27.466088 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 04:58:27.466088 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:58:27.466088 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 04:58:27.466088 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 04:58:27.466088 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 04:58:27.466088 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 04:58:27.466088 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 04:58:27.466088 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 04:58:27.466088 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 04:58:27.466088 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 04:58:27.466088 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7723784c-51e5-4936-b33a-caf9b1b87bab could not be found. Sep 20 04:58:27.466088 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:58:27.466088 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:58:27.466088 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:58:27.466088 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:58:27.466088 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:58:27.466088 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:58:27.466088 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 04:58:27.466088 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 04:58:27.466088 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 04:58:27.467565 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 04:58:27.467565 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 04:58:27.467565 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 04:58:27.467565 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 04:58:27.467565 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 04:58:27.467565 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 04:58:27.467565 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 04:58:27.467565 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7723784c-51e5-4936-b33a-caf9b1b87bab could not be found. Sep 20 04:58:27.467565 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:58:27.467565 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:58:27.467565 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:58:27.467565 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:58:27.467565 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:58:27.467565 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:58:27.467565 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 04:58:27.467565 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 04:58:27.467565 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7723784c-51e5-4936-b33a-caf9b1b87bab could not be found. Sep 20 04:58:27.467565 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:58:27.468911 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-e28165fc-6e92-465f-9528-652fd7583c61 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] Returning 404 to user: Instance 7723784c-51e5-4936-b33a-caf9b1b87bab could not be found. {{(pid=126813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 04:58:27.468911 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-e28165fc-6e92-465f-9528-652fd7583c61 tempest-AttachVolumeNegativeTest-1482924724 tempest-AttachVolumeNegativeTest-1482924724-project] 10.222.0.27 "GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab" status: 404 len: 111 microversion: 2.1 time: 0.028750 Sep 20 04:58:27.468911 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 414/564] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:58:27 2022] GET /compute/v2.1/servers/7723784c-51e5-4936-b33a-caf9b1b87bab => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 20 04:58:29.254176 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-a9e3da03-cecf-4305-b5cb-a87f73016f85 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:58:29.254859 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-a9e3da03-cecf-4305-b5cb-a87f73016f85 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:58:29.261632 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a9e3da03-cecf-4305-b5cb-a87f73016f85 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:29.262113 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a9e3da03-cecf-4305-b5cb-a87f73016f85 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:29.262545 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a9e3da03-cecf-4305-b5cb-a87f73016f85 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:29.263238 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a9e3da03-cecf-4305-b5cb-a87f73016f85 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:29.263683 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a9e3da03-cecf-4305-b5cb-a87f73016f85 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:29.264102 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a9e3da03-cecf-4305-b5cb-a87f73016f85 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:29.289894 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-a9e3da03-cecf-4305-b5cb-a87f73016f85 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7/ips" status: 200 len: 151 microversion: 2.20 time: 0.039666 Sep 20 04:58:29.290609 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 415/565] 10.222.0.27 () {60 vars in 1289 bytes} [Tue Sep 20 04:58:29 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 20 04:58:31.142816 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-b8ec8399-b77e-4e4c-9056-ae4297437804 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:58:31.143434 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-b8ec8399-b77e-4e4c-9056-ae4297437804 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:58:31.149887 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b8ec8399-b77e-4e4c-9056-ae4297437804 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:31.150371 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b8ec8399-b77e-4e4c-9056-ae4297437804 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:31.150810 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b8ec8399-b77e-4e4c-9056-ae4297437804 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:31.151875 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b8ec8399-b77e-4e4c-9056-ae4297437804 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:31.152578 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b8ec8399-b77e-4e4c-9056-ae4297437804 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:31.153594 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b8ec8399-b77e-4e4c-9056-ae4297437804 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:31.160757 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:58:31.183276 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.objects.instance [None req-b8ec8399-b77e-4e4c-9056-ae4297437804 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lazy-loading 'flavor' on Instance uuid 1dc0a271-e3e8-4883-b052-72a5c319c6b7 {{(pid=126813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 04:58:31.385433 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-b8ec8399-b77e-4e4c-9056-ae4297437804 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "POST /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7/action" status: 202 len: 0 microversion: 2.20 time: 0.246722 Sep 20 04:58:31.386083 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 416/566] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Sep 20 04:58:31 2022] POST /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 20 04:58:31.403049 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-4e901a46-e814-4aed-8243-5e3a00832d6f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:58:31.404813 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-4e901a46-e814-4aed-8243-5e3a00832d6f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:58:31.413319 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4e901a46-e814-4aed-8243-5e3a00832d6f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:31.415162 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4e901a46-e814-4aed-8243-5e3a00832d6f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:31.415630 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4e901a46-e814-4aed-8243-5e3a00832d6f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:31.416331 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4e901a46-e814-4aed-8243-5e3a00832d6f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:31.416813 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4e901a46-e814-4aed-8243-5e3a00832d6f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:31.417236 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4e901a46-e814-4aed-8243-5e3a00832d6f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:31.576024 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-4e901a46-e814-4aed-8243-5e3a00832d6f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:31.584314 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-4e901a46-e814-4aed-8243-5e3a00832d6f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:31.586032 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-4e901a46-e814-4aed-8243-5e3a00832d6f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:31.587203 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-4e901a46-e814-4aed-8243-5e3a00832d6f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1722 microversion: 2.20 time: 0.195848 Sep 20 04:58:31.587855 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 417/567] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:58:31 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 04:58:32.612551 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-357f6d4c-3c1a-4894-b6ae-0afef4d45df0 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:58:32.613206 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-357f6d4c-3c1a-4894-b6ae-0afef4d45df0 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:58:32.619494 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-357f6d4c-3c1a-4894-b6ae-0afef4d45df0 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:32.619992 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-357f6d4c-3c1a-4894-b6ae-0afef4d45df0 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:32.620422 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-357f6d4c-3c1a-4894-b6ae-0afef4d45df0 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:32.621130 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-357f6d4c-3c1a-4894-b6ae-0afef4d45df0 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:32.621578 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-357f6d4c-3c1a-4894-b6ae-0afef4d45df0 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:32.621998 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-357f6d4c-3c1a-4894-b6ae-0afef4d45df0 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:32.754644 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-357f6d4c-3c1a-4894-b6ae-0afef4d45df0 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:32.762791 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-357f6d4c-3c1a-4894-b6ae-0afef4d45df0 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:32.764245 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-357f6d4c-3c1a-4894-b6ae-0afef4d45df0 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:32.765685 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-357f6d4c-3c1a-4894-b6ae-0afef4d45df0 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1722 microversion: 2.20 time: 0.157025 Sep 20 04:58:32.766245 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 418/568] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:58:32 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 04:58:33.790468 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-34c9b3bb-fdb2-474d-aced-8e9ed14f5e4e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:58:33.791135 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-34c9b3bb-fdb2-474d-aced-8e9ed14f5e4e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:58:33.797696 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-34c9b3bb-fdb2-474d-aced-8e9ed14f5e4e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:33.798186 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-34c9b3bb-fdb2-474d-aced-8e9ed14f5e4e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:33.798629 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-34c9b3bb-fdb2-474d-aced-8e9ed14f5e4e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:33.799327 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-34c9b3bb-fdb2-474d-aced-8e9ed14f5e4e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:33.799786 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-34c9b3bb-fdb2-474d-aced-8e9ed14f5e4e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:33.800266 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-34c9b3bb-fdb2-474d-aced-8e9ed14f5e4e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:33.933642 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-34c9b3bb-fdb2-474d-aced-8e9ed14f5e4e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:33.942052 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-34c9b3bb-fdb2-474d-aced-8e9ed14f5e4e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:33.943505 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-34c9b3bb-fdb2-474d-aced-8e9ed14f5e4e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:33.944686 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-34c9b3bb-fdb2-474d-aced-8e9ed14f5e4e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1722 microversion: 2.20 time: 0.158217 Sep 20 04:58:33.945241 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 419/569] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:58:33 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 04:58:34.970073 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-a831c3dc-e21b-40b4-9a1d-c97aa79da7bd tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:58:34.971362 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-a831c3dc-e21b-40b4-9a1d-c97aa79da7bd tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:58:34.979078 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a831c3dc-e21b-40b4-9a1d-c97aa79da7bd tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:34.979607 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a831c3dc-e21b-40b4-9a1d-c97aa79da7bd tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:34.980239 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a831c3dc-e21b-40b4-9a1d-c97aa79da7bd tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:34.980967 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a831c3dc-e21b-40b4-9a1d-c97aa79da7bd tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:34.981587 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a831c3dc-e21b-40b4-9a1d-c97aa79da7bd tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:34.982012 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a831c3dc-e21b-40b4-9a1d-c97aa79da7bd tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:35.142740 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-a831c3dc-e21b-40b4-9a1d-c97aa79da7bd tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:35.153237 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-a831c3dc-e21b-40b4-9a1d-c97aa79da7bd tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:35.155374 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-a831c3dc-e21b-40b4-9a1d-c97aa79da7bd tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:35.157144 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-a831c3dc-e21b-40b4-9a1d-c97aa79da7bd tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1722 microversion: 2.20 time: 0.190360 Sep 20 04:58:35.169231 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 420/570] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:58:34 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 04:58:35.230047 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 20 04:58:35.230525 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: Tue Sep 20 04:58:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.27) !!! Sep 20 04:58:36.182603 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-f58b2c2c-000f-4cf9-b575-678726da2069 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:58:36.183205 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-f58b2c2c-000f-4cf9-b575-678726da2069 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:58:36.190214 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f58b2c2c-000f-4cf9-b575-678726da2069 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:36.190697 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f58b2c2c-000f-4cf9-b575-678726da2069 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:36.191133 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f58b2c2c-000f-4cf9-b575-678726da2069 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:36.191974 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f58b2c2c-000f-4cf9-b575-678726da2069 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:36.192431 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f58b2c2c-000f-4cf9-b575-678726da2069 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:36.192879 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f58b2c2c-000f-4cf9-b575-678726da2069 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:36.327000 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-f58b2c2c-000f-4cf9-b575-678726da2069 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:36.335135 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-f58b2c2c-000f-4cf9-b575-678726da2069 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:36.337224 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-f58b2c2c-000f-4cf9-b575-678726da2069 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:36.338392 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-f58b2c2c-000f-4cf9-b575-678726da2069 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1722 microversion: 2.20 time: 0.159982 Sep 20 04:58:36.338988 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 421/571] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:58:36 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 04:58:37.364322 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-9949088a-6045-4e05-8902-db7250cbf2bc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:58:37.365787 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-9949088a-6045-4e05-8902-db7250cbf2bc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:58:37.372997 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9949088a-6045-4e05-8902-db7250cbf2bc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:37.373565 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9949088a-6045-4e05-8902-db7250cbf2bc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:37.374065 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9949088a-6045-4e05-8902-db7250cbf2bc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:37.374814 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9949088a-6045-4e05-8902-db7250cbf2bc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:37.375358 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9949088a-6045-4e05-8902-db7250cbf2bc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:37.375944 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9949088a-6045-4e05-8902-db7250cbf2bc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:37.519782 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-9949088a-6045-4e05-8902-db7250cbf2bc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:37.528435 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-9949088a-6045-4e05-8902-db7250cbf2bc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:37.529920 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-9949088a-6045-4e05-8902-db7250cbf2bc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:37.531079 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-9949088a-6045-4e05-8902-db7250cbf2bc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1722 microversion: 2.20 time: 0.170598 Sep 20 04:58:37.531632 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 422/572] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:58:37 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 04:58:38.556913 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-2f397989-b0bb-47ab-92e9-60fd6a5f65c7 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:58:38.557520 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-2f397989-b0bb-47ab-92e9-60fd6a5f65c7 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:58:38.563977 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2f397989-b0bb-47ab-92e9-60fd6a5f65c7 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:38.564459 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2f397989-b0bb-47ab-92e9-60fd6a5f65c7 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:38.564930 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2f397989-b0bb-47ab-92e9-60fd6a5f65c7 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:38.565621 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2f397989-b0bb-47ab-92e9-60fd6a5f65c7 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:38.566069 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2f397989-b0bb-47ab-92e9-60fd6a5f65c7 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:38.566490 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2f397989-b0bb-47ab-92e9-60fd6a5f65c7 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:38.706708 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-2f397989-b0bb-47ab-92e9-60fd6a5f65c7 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:38.714834 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-2f397989-b0bb-47ab-92e9-60fd6a5f65c7 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:38.716278 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-2f397989-b0bb-47ab-92e9-60fd6a5f65c7 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:38.717456 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-2f397989-b0bb-47ab-92e9-60fd6a5f65c7 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1722 microversion: 2.20 time: 0.164971 Sep 20 04:58:38.718012 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 423/573] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:58:38 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 04:58:39.746709 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-8dbbfcd2-f58d-4bea-afcf-900a8eeb51b5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:58:39.747641 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-8dbbfcd2-f58d-4bea-afcf-900a8eeb51b5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:58:39.751146 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:58:39.758672 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8dbbfcd2-f58d-4bea-afcf-900a8eeb51b5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:39.759137 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8dbbfcd2-f58d-4bea-afcf-900a8eeb51b5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:39.759568 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8dbbfcd2-f58d-4bea-afcf-900a8eeb51b5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:39.760414 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8dbbfcd2-f58d-4bea-afcf-900a8eeb51b5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:39.761126 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8dbbfcd2-f58d-4bea-afcf-900a8eeb51b5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:39.761760 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8dbbfcd2-f58d-4bea-afcf-900a8eeb51b5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:39.898515 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-8dbbfcd2-f58d-4bea-afcf-900a8eeb51b5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:39.906589 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-8dbbfcd2-f58d-4bea-afcf-900a8eeb51b5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:39.908056 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-8dbbfcd2-f58d-4bea-afcf-900a8eeb51b5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:39.909248 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-8dbbfcd2-f58d-4bea-afcf-900a8eeb51b5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1722 microversion: 2.20 time: 0.169286 Sep 20 04:58:39.909848 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 424/574] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:58:39 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 04:58:40.935055 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-2af4a6c6-fd3f-4313-8554-682db6d27e8b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:58:40.936453 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-2af4a6c6-fd3f-4313-8554-682db6d27e8b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:58:40.949364 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2af4a6c6-fd3f-4313-8554-682db6d27e8b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:40.949364 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2af4a6c6-fd3f-4313-8554-682db6d27e8b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:40.949364 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2af4a6c6-fd3f-4313-8554-682db6d27e8b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:40.949364 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2af4a6c6-fd3f-4313-8554-682db6d27e8b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:40.949743 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2af4a6c6-fd3f-4313-8554-682db6d27e8b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:40.949743 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2af4a6c6-fd3f-4313-8554-682db6d27e8b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:41.076486 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-2af4a6c6-fd3f-4313-8554-682db6d27e8b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:41.084540 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-2af4a6c6-fd3f-4313-8554-682db6d27e8b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:41.086144 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-2af4a6c6-fd3f-4313-8554-682db6d27e8b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:41.087805 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-2af4a6c6-fd3f-4313-8554-682db6d27e8b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1722 microversion: 2.20 time: 0.157358 Sep 20 04:58:41.088369 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 425/575] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:58:40 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 04:58:42.112952 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-037d86bc-32bc-4f2a-9c5a-e93fcbed8b52 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:58:42.113745 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-037d86bc-32bc-4f2a-9c5a-e93fcbed8b52 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:58:42.120052 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-037d86bc-32bc-4f2a-9c5a-e93fcbed8b52 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:42.120527 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-037d86bc-32bc-4f2a-9c5a-e93fcbed8b52 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:42.120991 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-037d86bc-32bc-4f2a-9c5a-e93fcbed8b52 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:42.121665 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-037d86bc-32bc-4f2a-9c5a-e93fcbed8b52 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:42.122107 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-037d86bc-32bc-4f2a-9c5a-e93fcbed8b52 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:42.122532 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-037d86bc-32bc-4f2a-9c5a-e93fcbed8b52 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:42.251949 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-037d86bc-32bc-4f2a-9c5a-e93fcbed8b52 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:42.259931 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-037d86bc-32bc-4f2a-9c5a-e93fcbed8b52 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:42.261410 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-037d86bc-32bc-4f2a-9c5a-e93fcbed8b52 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:42.262543 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-037d86bc-32bc-4f2a-9c5a-e93fcbed8b52 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1722 microversion: 2.20 time: 0.153670 Sep 20 04:58:42.263087 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 426/576] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:58:42 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 04:58:43.288946 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-6149df42-ac23-4c9b-be3c-bb3ed569e595 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:58:43.289607 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-6149df42-ac23-4c9b-be3c-bb3ed569e595 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:58:43.296218 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6149df42-ac23-4c9b-be3c-bb3ed569e595 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:43.296728 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6149df42-ac23-4c9b-be3c-bb3ed569e595 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:43.297170 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6149df42-ac23-4c9b-be3c-bb3ed569e595 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:43.297857 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6149df42-ac23-4c9b-be3c-bb3ed569e595 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:43.298311 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6149df42-ac23-4c9b-be3c-bb3ed569e595 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:43.298742 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6149df42-ac23-4c9b-be3c-bb3ed569e595 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:43.422686 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-6149df42-ac23-4c9b-be3c-bb3ed569e595 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:43.430915 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-6149df42-ac23-4c9b-be3c-bb3ed569e595 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:43.432948 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-6149df42-ac23-4c9b-be3c-bb3ed569e595 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:43.434808 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-6149df42-ac23-4c9b-be3c-bb3ed569e595 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1722 microversion: 2.20 time: 0.149802 Sep 20 04:58:43.435804 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 427/577] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:58:43 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 04:58:44.462028 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-18129860-8ae6-4620-98c6-71b246eb5488 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:58:44.462659 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-18129860-8ae6-4620-98c6-71b246eb5488 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:58:44.469035 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-18129860-8ae6-4620-98c6-71b246eb5488 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:44.469509 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-18129860-8ae6-4620-98c6-71b246eb5488 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:44.469934 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-18129860-8ae6-4620-98c6-71b246eb5488 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:44.470635 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-18129860-8ae6-4620-98c6-71b246eb5488 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:44.471083 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-18129860-8ae6-4620-98c6-71b246eb5488 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:44.471497 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-18129860-8ae6-4620-98c6-71b246eb5488 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:44.617266 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-18129860-8ae6-4620-98c6-71b246eb5488 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:44.625331 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-18129860-8ae6-4620-98c6-71b246eb5488 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:44.626766 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-18129860-8ae6-4620-98c6-71b246eb5488 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:44.627903 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-18129860-8ae6-4620-98c6-71b246eb5488 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1722 microversion: 2.20 time: 0.170267 Sep 20 04:58:44.628455 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 428/578] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:58:44 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 04:58:45.654233 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-ab6cdf84-36d0-424b-b086-48759d8c6c30 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:58:45.655473 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-ab6cdf84-36d0-424b-b086-48759d8c6c30 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:58:45.661864 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ab6cdf84-36d0-424b-b086-48759d8c6c30 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:45.662266 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ab6cdf84-36d0-424b-b086-48759d8c6c30 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:45.662693 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ab6cdf84-36d0-424b-b086-48759d8c6c30 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:45.663366 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ab6cdf84-36d0-424b-b086-48759d8c6c30 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:45.663813 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ab6cdf84-36d0-424b-b086-48759d8c6c30 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:45.664230 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ab6cdf84-36d0-424b-b086-48759d8c6c30 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:45.796370 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-ab6cdf84-36d0-424b-b086-48759d8c6c30 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:45.805379 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-ab6cdf84-36d0-424b-b086-48759d8c6c30 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:45.806832 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-ab6cdf84-36d0-424b-b086-48759d8c6c30 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:45.808002 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-ab6cdf84-36d0-424b-b086-48759d8c6c30 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1722 microversion: 2.20 time: 0.157706 Sep 20 04:58:45.808556 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 429/579] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:58:45 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 04:58:46.835107 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-5f3ec7eb-485f-4e5a-953c-c6a313850437 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:58:46.835658 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-5f3ec7eb-485f-4e5a-953c-c6a313850437 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:58:46.848101 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5f3ec7eb-485f-4e5a-953c-c6a313850437 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:46.848785 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5f3ec7eb-485f-4e5a-953c-c6a313850437 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:46.849165 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5f3ec7eb-485f-4e5a-953c-c6a313850437 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:46.850028 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5f3ec7eb-485f-4e5a-953c-c6a313850437 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:46.850479 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5f3ec7eb-485f-4e5a-953c-c6a313850437 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:46.850899 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5f3ec7eb-485f-4e5a-953c-c6a313850437 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:46.997175 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-5f3ec7eb-485f-4e5a-953c-c6a313850437 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:47.000634 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:58:47.006209 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-5f3ec7eb-485f-4e5a-953c-c6a313850437 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:47.007673 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-5f3ec7eb-485f-4e5a-953c-c6a313850437 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:47.009419 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-5f3ec7eb-485f-4e5a-953c-c6a313850437 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1722 microversion: 2.20 time: 0.178844 Sep 20 04:58:47.009987 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 430/580] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:58:46 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 04:58:47.985838 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-a9f6dd02-8cc5-4353-a930-311c99b26ab0 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:58:47.986404 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-a9f6dd02-8cc5-4353-a930-311c99b26ab0 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: 417f5e13-88b2-4fc7-b79a-fe70372ed20d] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:58:47.993660 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a9f6dd02-8cc5-4353-a930-311c99b26ab0 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:47.994164 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a9f6dd02-8cc5-4353-a930-311c99b26ab0 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:47.994593 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a9f6dd02-8cc5-4353-a930-311c99b26ab0 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:47.995270 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a9f6dd02-8cc5-4353-a930-311c99b26ab0 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:47.995724 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a9f6dd02-8cc5-4353-a930-311c99b26ab0 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:47.996141 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a9f6dd02-8cc5-4353-a930-311c99b26ab0 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:48.021648 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-a9f6dd02-8cc5-4353-a930-311c99b26ab0 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: 417f5e13-88b2-4fc7-b79a-fe70372ed20d] Going to try to terminate instance {{(pid=126813) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 20 04:58:48.094050 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-a9f6dd02-8cc5-4353-a930-311c99b26ab0 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "DELETE /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d" status: 204 len: 0 microversion: 2.1 time: 0.113119 Sep 20 04:58:48.094806 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 431/581] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Sep 20 04:58:47 2022] DELETE /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 20 04:58:48.100397 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-632d1a97-f940-4eb1-9eaa-1a9d85d7683f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:58:48.101168 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-632d1a97-f940-4eb1-9eaa-1a9d85d7683f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:58:48.107524 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-632d1a97-f940-4eb1-9eaa-1a9d85d7683f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:48.108006 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-632d1a97-f940-4eb1-9eaa-1a9d85d7683f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:48.108444 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-632d1a97-f940-4eb1-9eaa-1a9d85d7683f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:48.109161 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-632d1a97-f940-4eb1-9eaa-1a9d85d7683f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:48.109614 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-632d1a97-f940-4eb1-9eaa-1a9d85d7683f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:48.110068 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-632d1a97-f940-4eb1-9eaa-1a9d85d7683f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:48.248727 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-632d1a97-f940-4eb1-9eaa-1a9d85d7683f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:48.257920 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-632d1a97-f940-4eb1-9eaa-1a9d85d7683f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:48.258930 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-632d1a97-f940-4eb1-9eaa-1a9d85d7683f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:48.260098 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-632d1a97-f940-4eb1-9eaa-1a9d85d7683f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1743 microversion: 2.20 time: 0.164166 Sep 20 04:58:48.260669 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 432/582] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:58:48 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1743 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 04:58:48.265339 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-5301ca94-1cf2-4740-8500-70910e921e9c tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:58:48.265947 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-5301ca94-1cf2-4740-8500-70910e921e9c tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: 417f5e13-88b2-4fc7-b79a-fe70372ed20d] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:58:48.272782 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5301ca94-1cf2-4740-8500-70910e921e9c tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:48.273167 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5301ca94-1cf2-4740-8500-70910e921e9c tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:48.273615 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5301ca94-1cf2-4740-8500-70910e921e9c tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:48.277586 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5301ca94-1cf2-4740-8500-70910e921e9c tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:48.277586 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5301ca94-1cf2-4740-8500-70910e921e9c tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:48.277586 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5301ca94-1cf2-4740-8500-70910e921e9c tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:48.420359 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-5301ca94-1cf2-4740-8500-70910e921e9c tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:48.429359 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-5301ca94-1cf2-4740-8500-70910e921e9c tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d" status: 200 len: 1576 microversion: 2.1 time: 0.167665 Sep 20 04:58:48.430149 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 433/583] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:58:48 2022] GET /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:58:49.287267 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-f815f728-8a78-4c88-9f72-2cdc435e4794 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:58:49.287908 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-f815f728-8a78-4c88-9f72-2cdc435e4794 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:58:49.294833 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f815f728-8a78-4c88-9f72-2cdc435e4794 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:49.295334 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f815f728-8a78-4c88-9f72-2cdc435e4794 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:49.295756 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f815f728-8a78-4c88-9f72-2cdc435e4794 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:49.296444 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f815f728-8a78-4c88-9f72-2cdc435e4794 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:49.296939 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f815f728-8a78-4c88-9f72-2cdc435e4794 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:49.297349 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f815f728-8a78-4c88-9f72-2cdc435e4794 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:49.488646 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-f815f728-8a78-4c88-9f72-2cdc435e4794 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:49.496874 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-f815f728-8a78-4c88-9f72-2cdc435e4794 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:49.498323 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-f815f728-8a78-4c88-9f72-2cdc435e4794 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:49.499481 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-f815f728-8a78-4c88-9f72-2cdc435e4794 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1743 microversion: 2.20 time: 0.216506 Sep 20 04:58:49.500044 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 434/584] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:58:49 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1743 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 04:58:49.504533 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-edc1696c-f24c-4657-9895-fe77589b3acf tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:58:49.505330 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-edc1696c-f24c-4657-9895-fe77589b3acf tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: 417f5e13-88b2-4fc7-b79a-fe70372ed20d] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:58:49.511009 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-edc1696c-f24c-4657-9895-fe77589b3acf tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:49.511495 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-edc1696c-f24c-4657-9895-fe77589b3acf tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:49.511932 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-edc1696c-f24c-4657-9895-fe77589b3acf tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:49.512622 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-edc1696c-f24c-4657-9895-fe77589b3acf tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:49.513191 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-edc1696c-f24c-4657-9895-fe77589b3acf tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:49.513617 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-edc1696c-f24c-4657-9895-fe77589b3acf tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:49.655061 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-edc1696c-f24c-4657-9895-fe77589b3acf tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:49.663291 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-edc1696c-f24c-4657-9895-fe77589b3acf tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d" status: 200 len: 1576 microversion: 2.1 time: 0.162102 Sep 20 04:58:49.663957 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 435/585] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:58:49 2022] GET /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:58:50.535920 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-02d73b57-91db-4636-91c6-94322fb7fa73 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:58:50.541557 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-02d73b57-91db-4636-91c6-94322fb7fa73 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:58:50.562991 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-02d73b57-91db-4636-91c6-94322fb7fa73 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:50.564753 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-02d73b57-91db-4636-91c6-94322fb7fa73 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:50.566623 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-02d73b57-91db-4636-91c6-94322fb7fa73 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:50.568296 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-02d73b57-91db-4636-91c6-94322fb7fa73 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:50.568785 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-02d73b57-91db-4636-91c6-94322fb7fa73 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:50.569221 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-02d73b57-91db-4636-91c6-94322fb7fa73 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:50.806233 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-02d73b57-91db-4636-91c6-94322fb7fa73 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:50.819086 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-02d73b57-91db-4636-91c6-94322fb7fa73 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:50.821541 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-02d73b57-91db-4636-91c6-94322fb7fa73 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:50.822715 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-02d73b57-91db-4636-91c6-94322fb7fa73 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1738 microversion: 2.20 time: 0.298001 Sep 20 04:58:50.823277 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 436/586] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:58:50 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1738 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 04:58:50.827654 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-8ddba8be-eb86-40e9-a3fb-f06ab4148f41 req-852a843c-80f8-435e-8208-6fe5a08d7d3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dc0a271-e3e8-4883-b052-72a5c319c6b7", "name": "network-vif-plugged", "status": "completed", "tag": "91a0df87-3f74-4106-92a9-e9a99f1cd365"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:58:50.857332 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-8ddba8be-eb86-40e9-a3fb-f06ab4148f41 req-852a843c-80f8-435e-8208-6fe5a08d7d3c service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:50.861719 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-8ddba8be-eb86-40e9-a3fb-f06ab4148f41 req-852a843c-80f8-435e-8208-6fe5a08d7d3c service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:50.862172 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-8ddba8be-eb86-40e9-a3fb-f06ab4148f41 req-852a843c-80f8-435e-8208-6fe5a08d7d3c service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:50.878556 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-8ddba8be-eb86-40e9-a3fb-f06ab4148f41 req-852a843c-80f8-435e-8208-6fe5a08d7d3c service nova] Creating event network-vif-plugged:91a0df87-3f74-4106-92a9-e9a99f1cd365 for instance 1dc0a271-e3e8-4883-b052-72a5c319c6b7 on hv-cinder-75671 Sep 20 04:58:50.901103 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-8ddba8be-eb86-40e9-a3fb-f06ab4148f41 req-852a843c-80f8-435e-8208-6fe5a08d7d3c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076588 Sep 20 04:58:50.902309 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 437/587] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 04:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:58:50.909160 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-3bc8d77c-3f3a-43b1-9c2f-3ee125679aaf tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:58:50.909851 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-3bc8d77c-3f3a-43b1-9c2f-3ee125679aaf tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: 417f5e13-88b2-4fc7-b79a-fe70372ed20d] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:58:50.919078 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3bc8d77c-3f3a-43b1-9c2f-3ee125679aaf tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:50.923722 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3bc8d77c-3f3a-43b1-9c2f-3ee125679aaf tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:50.924353 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3bc8d77c-3f3a-43b1-9c2f-3ee125679aaf tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:50.926704 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3bc8d77c-3f3a-43b1-9c2f-3ee125679aaf tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:50.927332 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3bc8d77c-3f3a-43b1-9c2f-3ee125679aaf tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:50.932952 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3bc8d77c-3f3a-43b1-9c2f-3ee125679aaf tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:51.104900 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-3bc8d77c-3f3a-43b1-9c2f-3ee125679aaf tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:51.132529 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-3bc8d77c-3f3a-43b1-9c2f-3ee125679aaf tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d" status: 200 len: 1509 microversion: 2.1 time: 0.224306 Sep 20 04:58:51.134011 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 438/588] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:58:50 2022] GET /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d => generated 1509 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:58:51.138755 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-1ddab98b-5cd0-4cf9-aa16-21d7bf225097 req-abcb4f04-9e00-4da3-bca2-738f1312a8aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "417f5e13-88b2-4fc7-b79a-fe70372ed20d", "name": "network-vif-deleted", "tag": "6b28a7ec-b466-45f0-86a8-63563916d1bd"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:58:51.166584 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-1ddab98b-5cd0-4cf9-aa16-21d7bf225097 req-abcb4f04-9e00-4da3-bca2-738f1312a8aa service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:51.167226 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-1ddab98b-5cd0-4cf9-aa16-21d7bf225097 req-abcb4f04-9e00-4da3-bca2-738f1312a8aa service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:51.169823 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-1ddab98b-5cd0-4cf9-aa16-21d7bf225097 req-abcb4f04-9e00-4da3-bca2-738f1312a8aa service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:51.196157 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-1ddab98b-5cd0-4cf9-aa16-21d7bf225097 req-abcb4f04-9e00-4da3-bca2-738f1312a8aa service nova] Creating event network-vif-deleted:6b28a7ec-b466-45f0-86a8-63563916d1bd for instance 417f5e13-88b2-4fc7-b79a-fe70372ed20d on hv-cinder-75671 Sep 20 04:58:51.209803 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-1ddab98b-5cd0-4cf9-aa16-21d7bf225097 req-abcb4f04-9e00-4da3-bca2-738f1312a8aa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074384 Sep 20 04:58:51.213910 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 439/589] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 04:58:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:58:51.858445 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-4491083b-2b44-485d-b5a2-59bc1aeb8cce tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:58:51.859141 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-4491083b-2b44-485d-b5a2-59bc1aeb8cce tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:58:51.866401 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4491083b-2b44-485d-b5a2-59bc1aeb8cce tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:51.866885 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4491083b-2b44-485d-b5a2-59bc1aeb8cce tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:51.869292 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4491083b-2b44-485d-b5a2-59bc1aeb8cce tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:51.870044 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4491083b-2b44-485d-b5a2-59bc1aeb8cce tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:51.870503 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4491083b-2b44-485d-b5a2-59bc1aeb8cce tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:51.870959 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4491083b-2b44-485d-b5a2-59bc1aeb8cce tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:52.093451 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-4491083b-2b44-485d-b5a2-59bc1aeb8cce tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:52.107474 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-4491083b-2b44-485d-b5a2-59bc1aeb8cce tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:52.109549 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-4491083b-2b44-485d-b5a2-59bc1aeb8cce tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:52.110982 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-4491083b-2b44-485d-b5a2-59bc1aeb8cce tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1738 microversion: 2.20 time: 0.256728 Sep 20 04:58:52.111699 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 440/590] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:58:51 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1738 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 04:58:52.163125 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-a482724a-9499-46e0-a41b-8ae6855a1534 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:58:52.163787 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-a482724a-9499-46e0-a41b-8ae6855a1534 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: 417f5e13-88b2-4fc7-b79a-fe70372ed20d] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:58:52.175726 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a482724a-9499-46e0-a41b-8ae6855a1534 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:52.176230 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a482724a-9499-46e0-a41b-8ae6855a1534 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:52.176694 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a482724a-9499-46e0-a41b-8ae6855a1534 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:52.177407 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a482724a-9499-46e0-a41b-8ae6855a1534 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:52.183699 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a482724a-9499-46e0-a41b-8ae6855a1534 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:52.184196 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a482724a-9499-46e0-a41b-8ae6855a1534 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:52.220041 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.wsgi [None req-a482724a-9499-46e0-a41b-8ae6855a1534 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] HTTP exception thrown: Instance 417f5e13-88b2-4fc7-b79a-fe70372ed20d could not be found. Sep 20 04:58:52.221801 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-a482724a-9499-46e0-a41b-8ae6855a1534 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Request method failure captured: Sep 20 04:58:52.221801 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: request: GET /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d HTTP/1.1 Sep 20 04:58:52.221801 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept: application/json Sep 20 04:58:52.221801 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept-Encoding: identity Sep 20 04:58:52.221801 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Connection: close Sep 20 04:58:52.221801 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Length: 0 Sep 20 04:58:52.221801 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Type: application/json Sep 20 04:58:52.221801 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Host: 10.222.0.27 Sep 20 04:58:52.221801 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Openstack-System-Scope: None Sep 20 04:58:52.221801 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: User-Agent: python-urllib3/1.26.12 Sep 20 04:58:52.221801 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Auth-Token: gAAAAABjKUfZVi2qjLqig0kK97c4DzE9yfobdafEkYrJ8uuLLci8Rz68vTzMuy-88mPU5lLRfY0UarUF0zVZuvtDO57qpqNazu2dNfa5mipjreQeWKMB1OTvXMsITFeAqBT73vXFkoJpxd6T7RNIw5Fh6jeMxd6M1thpIdxRJbBBnEA7X2xYE1k Sep 20 04:58:52.221801 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Id: None Sep 20 04:58:52.221801 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Name: None Sep 20 04:58:52.221801 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Identity-Status: Confirmed Sep 20 04:58:52.221801 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Is-Admin-Project: True Sep 20 04:58:52.221801 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Id: default Sep 20 04:58:52.221801 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Name: Default Sep 20 04:58:52.221801 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Id: 46ddf925b345471da94d05998a6a0540 Sep 20 04:58:52.221801 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Name: tempest-TestVolumeBootPattern-728794636 Sep 20 04:58:52.221801 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Role: reader,member Sep 20 04:58:52.221801 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Roles: reader,member Sep 20 04:58:52.223373 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/46ddf925b345471da94d05998a6a0540"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/46ddf925b345471da94d05998a6a0540"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_46ddf925b345471da94d05998a6a0540", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/46ddf925b345471da94d05998a6a0540"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 04:58:52.223373 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant: tempest-TestVolumeBootPattern-728794636 Sep 20 04:58:52.223373 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Id: 46ddf925b345471da94d05998a6a0540 Sep 20 04:58:52.223373 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Name: tempest-TestVolumeBootPattern-728794636 Sep 20 04:58:52.223373 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User: tempest-TestVolumeBootPattern-728794636-project Sep 20 04:58:52.223373 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Id: default Sep 20 04:58:52.223373 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Name: Default Sep 20 04:58:52.223373 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Id: 946a0fd33f754ce1aa534ab88dc95aa9 Sep 20 04:58:52.223373 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Name: tempest-TestVolumeBootPattern-728794636-project Sep 20 04:58:52.223373 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: method: > Sep 20 04:58:52.223373 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: exception: Instance 417f5e13-88b2-4fc7-b79a-fe70372ed20d could not be found. Sep 20 04:58:52.223373 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: action_args: {'id': '417f5e13-88b2-4fc7-b79a-fe70372ed20d'} Sep 20 04:58:52.224275 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 04:58:52.224275 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:58:52.224275 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 04:58:52.224275 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 04:58:52.224275 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 04:58:52.224275 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 04:58:52.224275 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 04:58:52.224275 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 04:58:52.224275 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 04:58:52.224275 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 04:58:52.224275 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 417f5e13-88b2-4fc7-b79a-fe70372ed20d could not be found. Sep 20 04:58:52.224275 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:58:52.224275 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:58:52.224275 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:58:52.224275 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:58:52.224275 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:58:52.224275 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:58:52.224275 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 04:58:52.224275 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 04:58:52.224275 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 04:58:52.226273 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 04:58:52.226273 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 04:58:52.226273 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 04:58:52.226273 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 04:58:52.226273 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 04:58:52.226273 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 04:58:52.226273 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 04:58:52.226273 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 417f5e13-88b2-4fc7-b79a-fe70372ed20d could not be found. Sep 20 04:58:52.226273 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:58:52.226273 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 04:58:52.226273 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:58:52.226273 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 04:58:52.226273 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 04:58:52.226273 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 04:58:52.226273 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 04:58:52.226273 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 04:58:52.226273 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 417f5e13-88b2-4fc7-b79a-fe70372ed20d could not be found. Sep 20 04:58:52.226273 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 04:58:52.227665 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-a482724a-9499-46e0-a41b-8ae6855a1534 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Returning 404 to user: Instance 417f5e13-88b2-4fc7-b79a-fe70372ed20d could not be found. {{(pid=126813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 04:58:52.227665 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-a482724a-9499-46e0-a41b-8ae6855a1534 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d" status: 404 len: 111 microversion: 2.1 time: 0.066434 Sep 20 04:58:52.227665 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 441/591] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:58:52 2022] GET /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 20 04:58:52.366485 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-e0234b37-bcf1-4f69-9d58-1472ee25088a tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1048831230", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-140645421", "security_groups": [{"name": "tempest-secgroup-smoke-293602655"}], "block_device_mapping_v2": [{"uuid": "7a0209e5-6307-4a9a-8c00-43279c69b9c2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6de81d04-87bb-4e82-ba15-9636966f9274"}]}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:58:52.564022 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.network.neutron [None req-e0234b37-bcf1-4f69-9d58-1472ee25088a tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] validate_networks() for [('6de81d04-87bb-4e82-ba15-9636966f9274', None, None, None, None, None)] {{(pid=126813) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 20 04:58:53.480068 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-e0234b37-bcf1-4f69-9d58-1472ee25088a tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Flavor limits 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 20 04:58:53.481399 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-e0234b37-bcf1-4f69-9d58-1472ee25088a tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Image limits 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 20 04:58:53.482134 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-e0234b37-bcf1-4f69-9d58-1472ee25088a tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Flavor pref 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 20 04:58:53.482815 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-e0234b37-bcf1-4f69-9d58-1472ee25088a tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Image pref 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 20 04:58:53.483466 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-e0234b37-bcf1-4f69-9d58-1472ee25088a tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 20 04:58:53.510779 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e0234b37-bcf1-4f69-9d58-1472ee25088a tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:53.512619 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e0234b37-bcf1-4f69-9d58-1472ee25088a tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:53.513227 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e0234b37-bcf1-4f69-9d58-1472ee25088a tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:53.514214 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e0234b37-bcf1-4f69-9d58-1472ee25088a tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:53.515472 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e0234b37-bcf1-4f69-9d58-1472ee25088a tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:53.516045 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e0234b37-bcf1-4f69-9d58-1472ee25088a tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:53.557806 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-e0234b37-bcf1-4f69-9d58-1472ee25088a tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Getting quotas for project 46ddf925b345471da94d05998a6a0540. Resources: {'ram', 'cores', 'instances'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 04:58:53.563182 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-e0234b37-bcf1-4f69-9d58-1472ee25088a tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Getting quotas for user 946a0fd33f754ce1aa534ab88dc95aa9 and project 46ddf925b345471da94d05998a6a0540. Resources: {'ram', 'cores', 'instances'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 04:58:53.645528 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-e0234b37-bcf1-4f69-9d58-1472ee25088a tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Going to run 1 instances... {{(pid=126813) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 20 04:58:53.648004 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-e0234b37-bcf1-4f69-9d58-1472ee25088a tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: cd514882-49cd-4d14-a8e1-b17b0605cd1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7a0209e5-6307-4a9a-8c00-43279c69b9c2',volume_size=None,volume_type=None)] {{(pid=126813) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 20 04:58:53.817515 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-e0234b37-bcf1-4f69-9d58-1472ee25088a tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.455137 Sep 20 04:58:53.818314 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 442/592] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Sep 20 04:58:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 1457 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 20 04:58:53.824899 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-deed310b-9ab9-4cfa-8b25-ec83fddd4eb7 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:58:53.825776 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-deed310b-9ab9-4cfa-8b25-ec83fddd4eb7 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:58:53.832357 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-deed310b-9ab9-4cfa-8b25-ec83fddd4eb7 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:53.833091 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-deed310b-9ab9-4cfa-8b25-ec83fddd4eb7 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:53.833524 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-deed310b-9ab9-4cfa-8b25-ec83fddd4eb7 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:53.834217 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-deed310b-9ab9-4cfa-8b25-ec83fddd4eb7 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:53.834654 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-deed310b-9ab9-4cfa-8b25-ec83fddd4eb7 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:53.835070 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-deed310b-9ab9-4cfa-8b25-ec83fddd4eb7 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:54.060265 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-deed310b-9ab9-4cfa-8b25-ec83fddd4eb7 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:54.069418 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-deed310b-9ab9-4cfa-8b25-ec83fddd4eb7 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:54.071106 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-deed310b-9ab9-4cfa-8b25-ec83fddd4eb7 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:54.073230 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-deed310b-9ab9-4cfa-8b25-ec83fddd4eb7 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1738 microversion: 2.20 time: 0.254031 Sep 20 04:58:54.074208 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 443/593] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:58:53 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1738 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 04:58:54.094070 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-6358e77f-9be4-4c52-841b-e63bf8bc0719 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:58:54.094876 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-6358e77f-9be4-4c52-841b-e63bf8bc0719 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: cd514882-49cd-4d14-a8e1-b17b0605cd1f] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:58:54.165386 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-6358e77f-9be4-4c52-841b-e63bf8bc0719 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:54.174268 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-6358e77f-9be4-4c52-841b-e63bf8bc0719 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/cd514882-49cd-4d14-a8e1-b17b0605cd1f" status: 200 len: 1094 microversion: 2.1 time: 0.098784 Sep 20 04:58:54.175863 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 444/594] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:58:54 2022] GET /compute/v2.1/servers/cd514882-49cd-4d14-a8e1-b17b0605cd1f => generated 1094 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:58:55.107091 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-94b16627-9538-4209-88dd-0feada5ebab9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:58:55.110217 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-94b16627-9538-4209-88dd-0feada5ebab9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:58:55.123483 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-94b16627-9538-4209-88dd-0feada5ebab9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:55.124334 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-94b16627-9538-4209-88dd-0feada5ebab9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:55.139267 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-94b16627-9538-4209-88dd-0feada5ebab9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:55.140685 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-94b16627-9538-4209-88dd-0feada5ebab9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:55.141182 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-94b16627-9538-4209-88dd-0feada5ebab9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:55.141622 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-94b16627-9538-4209-88dd-0feada5ebab9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:55.363211 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-94b16627-9538-4209-88dd-0feada5ebab9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:55.378148 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-94b16627-9538-4209-88dd-0feada5ebab9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:55.381141 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-94b16627-9538-4209-88dd-0feada5ebab9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:55.384854 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-94b16627-9538-4209-88dd-0feada5ebab9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1738 microversion: 2.20 time: 0.284867 Sep 20 04:58:55.387304 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 445/595] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:58:55 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1738 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 04:58:55.398310 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-9495f2cc-5906-458d-821a-a90f21c2e495 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:58:55.400790 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-9495f2cc-5906-458d-821a-a90f21c2e495 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: cd514882-49cd-4d14-a8e1-b17b0605cd1f] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:58:55.407314 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9495f2cc-5906-458d-821a-a90f21c2e495 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:55.408080 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9495f2cc-5906-458d-821a-a90f21c2e495 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:55.408844 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9495f2cc-5906-458d-821a-a90f21c2e495 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:55.409997 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9495f2cc-5906-458d-821a-a90f21c2e495 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:55.410667 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9495f2cc-5906-458d-821a-a90f21c2e495 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:55.411603 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9495f2cc-5906-458d-821a-a90f21c2e495 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:55.531243 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-9495f2cc-5906-458d-821a-a90f21c2e495 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:55.544410 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-9495f2cc-5906-458d-821a-a90f21c2e495 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/cd514882-49cd-4d14-a8e1-b17b0605cd1f" status: 200 len: 1210 microversion: 2.1 time: 0.155728 Sep 20 04:58:55.556626 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 446/596] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:58:55 2022] GET /compute/v2.1/servers/cd514882-49cd-4d14-a8e1-b17b0605cd1f => generated 1210 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:58:56.413138 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-78af523c-f27d-4dd0-b0d8-1ab7aebac115 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:58:56.416215 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-78af523c-f27d-4dd0-b0d8-1ab7aebac115 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:58:56.436834 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-78af523c-f27d-4dd0-b0d8-1ab7aebac115 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:56.437501 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-78af523c-f27d-4dd0-b0d8-1ab7aebac115 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:56.438257 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-78af523c-f27d-4dd0-b0d8-1ab7aebac115 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:56.439725 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-78af523c-f27d-4dd0-b0d8-1ab7aebac115 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:56.440338 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-78af523c-f27d-4dd0-b0d8-1ab7aebac115 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:56.440947 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-78af523c-f27d-4dd0-b0d8-1ab7aebac115 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:56.762770 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-78af523c-f27d-4dd0-b0d8-1ab7aebac115 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:56.797298 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-78af523c-f27d-4dd0-b0d8-1ab7aebac115 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:56.808995 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-78af523c-f27d-4dd0-b0d8-1ab7aebac115 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:56.810524 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-78af523c-f27d-4dd0-b0d8-1ab7aebac115 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1738 microversion: 2.20 time: 0.402859 Sep 20 04:58:56.811277 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 447/597] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:58:56 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1738 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 04:58:56.815995 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-aaed5c6b-9460-4d32-9c52-17f7220e14e6 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:58:56.824680 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-aaed5c6b-9460-4d32-9c52-17f7220e14e6 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: cd514882-49cd-4d14-a8e1-b17b0605cd1f] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:58:56.833756 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-aaed5c6b-9460-4d32-9c52-17f7220e14e6 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:56.834491 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-aaed5c6b-9460-4d32-9c52-17f7220e14e6 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:56.836784 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-aaed5c6b-9460-4d32-9c52-17f7220e14e6 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:56.838662 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-aaed5c6b-9460-4d32-9c52-17f7220e14e6 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:56.839701 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-aaed5c6b-9460-4d32-9c52-17f7220e14e6 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:56.841403 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-aaed5c6b-9460-4d32-9c52-17f7220e14e6 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:57.081877 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-aaed5c6b-9460-4d32-9c52-17f7220e14e6 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:57.095972 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-aaed5c6b-9460-4d32-9c52-17f7220e14e6 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/cd514882-49cd-4d14-a8e1-b17b0605cd1f" status: 200 len: 1265 microversion: 2.1 time: 0.283468 Sep 20 04:58:57.097232 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 448/598] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:58:56 2022] GET /compute/v2.1/servers/cd514882-49cd-4d14-a8e1-b17b0605cd1f => generated 1265 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:58:57.359271 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-91726475-769d-4759-86ba-d87f0a583139 req-d524dbbd-a222-4406-bc8a-0b84343a4f38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd514882-49cd-4d14-a8e1-b17b0605cd1f", "tag": "cdc3a8f8-3815-44e2-8784-9ad2e03e2914"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:58:57.377817 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-91726475-769d-4759-86ba-d87f0a583139 req-d524dbbd-a222-4406-bc8a-0b84343a4f38 service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:57.381469 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-91726475-769d-4759-86ba-d87f0a583139 req-d524dbbd-a222-4406-bc8a-0b84343a4f38 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:57.382335 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-91726475-769d-4759-86ba-d87f0a583139 req-d524dbbd-a222-4406-bc8a-0b84343a4f38 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:57.395853 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-91726475-769d-4759-86ba-d87f0a583139 req-d524dbbd-a222-4406-bc8a-0b84343a4f38 service nova] Creating event network-changed:cdc3a8f8-3815-44e2-8784-9ad2e03e2914 for instance cd514882-49cd-4d14-a8e1-b17b0605cd1f on hv-cinder-75671 Sep 20 04:58:57.402188 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-91726475-769d-4759-86ba-d87f0a583139 req-d524dbbd-a222-4406-bc8a-0b84343a4f38 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046646 Sep 20 04:58:57.403011 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 449/599] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 04:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:58:57.838681 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-a6bcb16c-f737-4f61-a706-f289b5044212 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:58:57.840096 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-a6bcb16c-f737-4f61-a706-f289b5044212 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:58:57.855712 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a6bcb16c-f737-4f61-a706-f289b5044212 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:57.856552 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a6bcb16c-f737-4f61-a706-f289b5044212 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:57.857817 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a6bcb16c-f737-4f61-a706-f289b5044212 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:57.858913 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a6bcb16c-f737-4f61-a706-f289b5044212 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:57.859582 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a6bcb16c-f737-4f61-a706-f289b5044212 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:57.860232 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a6bcb16c-f737-4f61-a706-f289b5044212 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:57.866090 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:58:58.024083 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-a6bcb16c-f737-4f61-a706-f289b5044212 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:58.036474 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-a6bcb16c-f737-4f61-a706-f289b5044212 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:58.038928 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-a6bcb16c-f737-4f61-a706-f289b5044212 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:58.041008 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-a6bcb16c-f737-4f61-a706-f289b5044212 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1738 microversion: 2.20 time: 0.207976 Sep 20 04:58:58.041585 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 450/600] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:58:57 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1738 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 04:58:58.123524 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-1eab9507-9ca3-4bbc-b753-4aa6a945ec72 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:58:58.124253 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-1eab9507-9ca3-4bbc-b753-4aa6a945ec72 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: cd514882-49cd-4d14-a8e1-b17b0605cd1f] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:58:58.131721 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1eab9507-9ca3-4bbc-b753-4aa6a945ec72 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:58.132226 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1eab9507-9ca3-4bbc-b753-4aa6a945ec72 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:58.132710 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1eab9507-9ca3-4bbc-b753-4aa6a945ec72 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:58.133812 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1eab9507-9ca3-4bbc-b753-4aa6a945ec72 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:58.134428 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1eab9507-9ca3-4bbc-b753-4aa6a945ec72 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:58.135019 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1eab9507-9ca3-4bbc-b753-4aa6a945ec72 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:58.325920 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-1eab9507-9ca3-4bbc-b753-4aa6a945ec72 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:58.339459 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-1eab9507-9ca3-4bbc-b753-4aa6a945ec72 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/cd514882-49cd-4d14-a8e1-b17b0605cd1f" status: 200 len: 1265 microversion: 2.1 time: 0.221787 Sep 20 04:58:58.340729 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 451/601] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:58:58 2022] GET /compute/v2.1/servers/cd514882-49cd-4d14-a8e1-b17b0605cd1f => generated 1265 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:58:59.067589 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-7c1c1067-5d89-4cb4-b456-4005da7b8138 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:58:59.068231 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-7c1c1067-5d89-4cb4-b456-4005da7b8138 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:58:59.079603 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7c1c1067-5d89-4cb4-b456-4005da7b8138 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:59.080330 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7c1c1067-5d89-4cb4-b456-4005da7b8138 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:59.081088 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7c1c1067-5d89-4cb4-b456-4005da7b8138 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:59.082130 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7c1c1067-5d89-4cb4-b456-4005da7b8138 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:59.082818 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7c1c1067-5d89-4cb4-b456-4005da7b8138 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:59.083349 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7c1c1067-5d89-4cb4-b456-4005da7b8138 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:59.275960 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-7c1c1067-5d89-4cb4-b456-4005da7b8138 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:59.289835 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-7c1c1067-5d89-4cb4-b456-4005da7b8138 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:59.297198 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-7c1c1067-5d89-4cb4-b456-4005da7b8138 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:59.298511 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-7c1c1067-5d89-4cb4-b456-4005da7b8138 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1738 microversion: 2.20 time: 0.235114 Sep 20 04:58:59.299275 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 452/602] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:58:59 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1738 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 04:58:59.372931 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-11a16830-21ce-43da-8f04-759a1334a620 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:58:59.373539 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-11a16830-21ce-43da-8f04-759a1334a620 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: cd514882-49cd-4d14-a8e1-b17b0605cd1f] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:58:59.382563 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-11a16830-21ce-43da-8f04-759a1334a620 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:59.383838 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-11a16830-21ce-43da-8f04-759a1334a620 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:59.384281 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-11a16830-21ce-43da-8f04-759a1334a620 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:59.385015 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-11a16830-21ce-43da-8f04-759a1334a620 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:58:59.385629 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-11a16830-21ce-43da-8f04-759a1334a620 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:58:59.386229 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-11a16830-21ce-43da-8f04-759a1334a620 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:58:59.566928 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-11a16830-21ce-43da-8f04-759a1334a620 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:58:59.575763 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-11a16830-21ce-43da-8f04-759a1334a620 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/cd514882-49cd-4d14-a8e1-b17b0605cd1f" status: 200 len: 1265 microversion: 2.1 time: 0.206787 Sep 20 04:58:59.576333 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 453/603] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:58:59 2022] GET /compute/v2.1/servers/cd514882-49cd-4d14-a8e1-b17b0605cd1f => generated 1265 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:59:00.328341 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-c381bd9c-162f-4af7-8be7-fb1d3125e728 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:59:00.329058 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-c381bd9c-162f-4af7-8be7-fb1d3125e728 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:59:00.337398 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c381bd9c-162f-4af7-8be7-fb1d3125e728 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:00.337895 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c381bd9c-162f-4af7-8be7-fb1d3125e728 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:00.338338 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c381bd9c-162f-4af7-8be7-fb1d3125e728 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:00.339037 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c381bd9c-162f-4af7-8be7-fb1d3125e728 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:00.339492 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c381bd9c-162f-4af7-8be7-fb1d3125e728 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:00.339914 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c381bd9c-162f-4af7-8be7-fb1d3125e728 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:00.489581 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-c381bd9c-162f-4af7-8be7-fb1d3125e728 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:00.499007 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-c381bd9c-162f-4af7-8be7-fb1d3125e728 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:00.501347 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-c381bd9c-162f-4af7-8be7-fb1d3125e728 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:00.502554 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-c381bd9c-162f-4af7-8be7-fb1d3125e728 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1738 microversion: 2.20 time: 0.180218 Sep 20 04:59:00.516694 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 454/604] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:59:00 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1738 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 04:59:00.599320 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-4a77ce70-89b6-4aef-bfee-a4aa4c34d38f tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:59:00.600392 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-4a77ce70-89b6-4aef-bfee-a4aa4c34d38f tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: cd514882-49cd-4d14-a8e1-b17b0605cd1f] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:59:00.609419 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4a77ce70-89b6-4aef-bfee-a4aa4c34d38f tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:00.610181 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4a77ce70-89b6-4aef-bfee-a4aa4c34d38f tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:00.610804 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4a77ce70-89b6-4aef-bfee-a4aa4c34d38f tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:00.611861 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4a77ce70-89b6-4aef-bfee-a4aa4c34d38f tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:00.612316 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4a77ce70-89b6-4aef-bfee-a4aa4c34d38f tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:00.612928 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4a77ce70-89b6-4aef-bfee-a4aa4c34d38f tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:00.795537 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-4a77ce70-89b6-4aef-bfee-a4aa4c34d38f tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:00.803507 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-4a77ce70-89b6-4aef-bfee-a4aa4c34d38f tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/cd514882-49cd-4d14-a8e1-b17b0605cd1f" status: 200 len: 1265 microversion: 2.1 time: 0.208184 Sep 20 04:59:00.820900 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 455/605] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:59:00 2022] GET /compute/v2.1/servers/cd514882-49cd-4d14-a8e1-b17b0605cd1f => generated 1265 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:59:01.528414 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-de234c15-a7b5-41ec-844d-c67c4bb578c6 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:59:01.529757 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-de234c15-a7b5-41ec-844d-c67c4bb578c6 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:59:01.544267 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-de234c15-a7b5-41ec-844d-c67c4bb578c6 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:01.545343 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-de234c15-a7b5-41ec-844d-c67c4bb578c6 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:01.546110 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-de234c15-a7b5-41ec-844d-c67c4bb578c6 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:01.547368 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-de234c15-a7b5-41ec-844d-c67c4bb578c6 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:01.548237 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-de234c15-a7b5-41ec-844d-c67c4bb578c6 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:01.549056 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-de234c15-a7b5-41ec-844d-c67c4bb578c6 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:01.724295 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-de234c15-a7b5-41ec-844d-c67c4bb578c6 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:01.746807 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-de234c15-a7b5-41ec-844d-c67c4bb578c6 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:01.748255 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-de234c15-a7b5-41ec-844d-c67c4bb578c6 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:01.749453 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-de234c15-a7b5-41ec-844d-c67c4bb578c6 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1738 microversion: 2.20 time: 0.225212 Sep 20 04:59:01.769960 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 456/606] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:59:01 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1738 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 04:59:01.830697 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-9e1d6975-1e35-47ea-98b4-cd6655581e69 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:59:01.831389 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-9e1d6975-1e35-47ea-98b4-cd6655581e69 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: cd514882-49cd-4d14-a8e1-b17b0605cd1f] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:59:01.840119 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9e1d6975-1e35-47ea-98b4-cd6655581e69 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:01.840769 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9e1d6975-1e35-47ea-98b4-cd6655581e69 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:01.841378 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9e1d6975-1e35-47ea-98b4-cd6655581e69 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:01.842253 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9e1d6975-1e35-47ea-98b4-cd6655581e69 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:01.842868 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9e1d6975-1e35-47ea-98b4-cd6655581e69 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:01.843290 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9e1d6975-1e35-47ea-98b4-cd6655581e69 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:01.997754 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-9e1d6975-1e35-47ea-98b4-cd6655581e69 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:02.006138 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-9e1d6975-1e35-47ea-98b4-cd6655581e69 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/cd514882-49cd-4d14-a8e1-b17b0605cd1f" status: 200 len: 1265 microversion: 2.1 time: 0.179247 Sep 20 04:59:02.007065 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 457/607] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:59:01 2022] GET /compute/v2.1/servers/cd514882-49cd-4d14-a8e1-b17b0605cd1f => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:59:02.795678 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-222a2e5c-39bb-436f-b24e-1ab829101a1e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:59:02.796369 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-222a2e5c-39bb-436f-b24e-1ab829101a1e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:59:02.802745 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-222a2e5c-39bb-436f-b24e-1ab829101a1e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:02.803230 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-222a2e5c-39bb-436f-b24e-1ab829101a1e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:02.803674 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-222a2e5c-39bb-436f-b24e-1ab829101a1e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:02.804363 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-222a2e5c-39bb-436f-b24e-1ab829101a1e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:02.804846 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-222a2e5c-39bb-436f-b24e-1ab829101a1e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:02.805273 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-222a2e5c-39bb-436f-b24e-1ab829101a1e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:02.931823 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-222a2e5c-39bb-436f-b24e-1ab829101a1e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:02.939969 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-222a2e5c-39bb-436f-b24e-1ab829101a1e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:02.941433 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-222a2e5c-39bb-436f-b24e-1ab829101a1e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:02.942656 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-222a2e5c-39bb-436f-b24e-1ab829101a1e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1738 microversion: 2.20 time: 0.150868 Sep 20 04:59:02.943209 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 458/608] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:59:02 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 04:59:03.030478 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-2523ae8f-3c5b-43c1-af3e-c7324ab702f7 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:59:03.031092 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-2523ae8f-3c5b-43c1-af3e-c7324ab702f7 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: cd514882-49cd-4d14-a8e1-b17b0605cd1f] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:59:03.040888 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2523ae8f-3c5b-43c1-af3e-c7324ab702f7 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:03.041431 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2523ae8f-3c5b-43c1-af3e-c7324ab702f7 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:03.041879 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2523ae8f-3c5b-43c1-af3e-c7324ab702f7 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:03.042664 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2523ae8f-3c5b-43c1-af3e-c7324ab702f7 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:03.043128 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2523ae8f-3c5b-43c1-af3e-c7324ab702f7 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:03.043560 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2523ae8f-3c5b-43c1-af3e-c7324ab702f7 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:03.187015 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-2523ae8f-3c5b-43c1-af3e-c7324ab702f7 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:03.195585 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-2523ae8f-3c5b-43c1-af3e-c7324ab702f7 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/cd514882-49cd-4d14-a8e1-b17b0605cd1f" status: 200 len: 1265 microversion: 2.1 time: 0.168222 Sep 20 04:59:03.196172 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 459/609] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:59:03 2022] GET /compute/v2.1/servers/cd514882-49cd-4d14-a8e1-b17b0605cd1f => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:59:03.977804 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-6ab9d75f-333a-4b5c-b702-2c6313825dd8 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:59:03.981077 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-6ab9d75f-333a-4b5c-b702-2c6313825dd8 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:59:03.984320 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell0:SELECT=2 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:59:03.989317 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6ab9d75f-333a-4b5c-b702-2c6313825dd8 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:03.991408 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6ab9d75f-333a-4b5c-b702-2c6313825dd8 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:03.992076 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6ab9d75f-333a-4b5c-b702-2c6313825dd8 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:03.992950 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6ab9d75f-333a-4b5c-b702-2c6313825dd8 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:03.994246 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6ab9d75f-333a-4b5c-b702-2c6313825dd8 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:03.994691 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6ab9d75f-333a-4b5c-b702-2c6313825dd8 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:04.129677 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-6ab9d75f-333a-4b5c-b702-2c6313825dd8 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:04.140421 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-6ab9d75f-333a-4b5c-b702-2c6313825dd8 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:04.141897 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-6ab9d75f-333a-4b5c-b702-2c6313825dd8 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:04.143101 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-6ab9d75f-333a-4b5c-b702-2c6313825dd8 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1720 microversion: 2.20 time: 0.172721 Sep 20 04:59:04.143672 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 460/610] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:59:03 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1720 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 04:59:04.218322 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-1ace6d3f-69b7-4a98-ac92-8aeb9be5609c tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:59:04.218945 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-1ace6d3f-69b7-4a98-ac92-8aeb9be5609c tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: cd514882-49cd-4d14-a8e1-b17b0605cd1f] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:59:04.220809 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell0:SELECT=8 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:59:04.226030 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1ace6d3f-69b7-4a98-ac92-8aeb9be5609c tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:04.226526 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1ace6d3f-69b7-4a98-ac92-8aeb9be5609c tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:04.227492 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1ace6d3f-69b7-4a98-ac92-8aeb9be5609c tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:04.227669 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1ace6d3f-69b7-4a98-ac92-8aeb9be5609c tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:04.228184 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1ace6d3f-69b7-4a98-ac92-8aeb9be5609c tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:04.228816 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1ace6d3f-69b7-4a98-ac92-8aeb9be5609c tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:04.366520 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-1ace6d3f-69b7-4a98-ac92-8aeb9be5609c tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:04.374705 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-1ace6d3f-69b7-4a98-ac92-8aeb9be5609c tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/cd514882-49cd-4d14-a8e1-b17b0605cd1f" status: 200 len: 1265 microversion: 2.1 time: 0.160210 Sep 20 04:59:04.375271 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 461/611] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:59:04 2022] GET /compute/v2.1/servers/cd514882-49cd-4d14-a8e1-b17b0605cd1f => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:59:05.169671 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-150a2638-3044-40d3-b895-ebceb5c300fe tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:59:05.170310 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-150a2638-3044-40d3-b895-ebceb5c300fe tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:59:05.172565 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:59:05.178147 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-150a2638-3044-40d3-b895-ebceb5c300fe tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:05.178645 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-150a2638-3044-40d3-b895-ebceb5c300fe tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:05.179790 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-150a2638-3044-40d3-b895-ebceb5c300fe tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:05.180708 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-150a2638-3044-40d3-b895-ebceb5c300fe tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:05.181167 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-150a2638-3044-40d3-b895-ebceb5c300fe tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:05.181599 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-150a2638-3044-40d3-b895-ebceb5c300fe tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:05.315486 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-150a2638-3044-40d3-b895-ebceb5c300fe tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:05.323971 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-150a2638-3044-40d3-b895-ebceb5c300fe tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:05.325460 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-150a2638-3044-40d3-b895-ebceb5c300fe tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:05.326662 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-150a2638-3044-40d3-b895-ebceb5c300fe tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1720 microversion: 2.20 time: 0.160805 Sep 20 04:59:05.327221 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 462/612] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:59:05 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 04:59:05.399205 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-e0d56d53-fe8f-49d9-abb7-190672131a81 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:59:05.399905 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-e0d56d53-fe8f-49d9-abb7-190672131a81 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: cd514882-49cd-4d14-a8e1-b17b0605cd1f] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:59:05.406077 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e0d56d53-fe8f-49d9-abb7-190672131a81 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:05.406643 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e0d56d53-fe8f-49d9-abb7-190672131a81 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:05.407256 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e0d56d53-fe8f-49d9-abb7-190672131a81 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:05.408091 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e0d56d53-fe8f-49d9-abb7-190672131a81 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:05.408774 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e0d56d53-fe8f-49d9-abb7-190672131a81 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:05.409297 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e0d56d53-fe8f-49d9-abb7-190672131a81 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:05.545844 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-e0d56d53-fe8f-49d9-abb7-190672131a81 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:05.553680 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-e0d56d53-fe8f-49d9-abb7-190672131a81 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/cd514882-49cd-4d14-a8e1-b17b0605cd1f" status: 200 len: 1265 microversion: 2.1 time: 0.158944 Sep 20 04:59:05.554246 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 463/613] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:59:05 2022] GET /compute/v2.1/servers/cd514882-49cd-4d14-a8e1-b17b0605cd1f => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:59:06.353519 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-fcf3c061-485d-4b8c-883f-9a6945b8c4f2 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:59:06.354232 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-fcf3c061-485d-4b8c-883f-9a6945b8c4f2 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:59:06.360614 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fcf3c061-485d-4b8c-883f-9a6945b8c4f2 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:06.361191 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fcf3c061-485d-4b8c-883f-9a6945b8c4f2 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:06.367500 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fcf3c061-485d-4b8c-883f-9a6945b8c4f2 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:06.372507 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fcf3c061-485d-4b8c-883f-9a6945b8c4f2 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:06.373299 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fcf3c061-485d-4b8c-883f-9a6945b8c4f2 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:06.373748 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fcf3c061-485d-4b8c-883f-9a6945b8c4f2 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:06.509283 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-fcf3c061-485d-4b8c-883f-9a6945b8c4f2 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:06.517730 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-fcf3c061-485d-4b8c-883f-9a6945b8c4f2 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:06.519178 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-fcf3c061-485d-4b8c-883f-9a6945b8c4f2 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:06.520329 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-fcf3c061-485d-4b8c-883f-9a6945b8c4f2 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1663 microversion: 2.20 time: 0.171541 Sep 20 04:59:06.520929 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 464/614] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:59:06 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1663 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 04:59:06.545778 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-41f8c67c-f759-40e9-9a11-a47a476b8f2a tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1139fa08-8a21-401a-8788-deded4967932"}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:59:06.548208 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-41f8c67c-f759-40e9-9a11-a47a476b8f2a tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:59:06.555849 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-41f8c67c-f759-40e9-9a11-a47a476b8f2a tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:06.556549 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-41f8c67c-f759-40e9-9a11-a47a476b8f2a tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:06.557073 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-41f8c67c-f759-40e9-9a11-a47a476b8f2a tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:06.557913 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-41f8c67c-f759-40e9-9a11-a47a476b8f2a tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:06.558584 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-41f8c67c-f759-40e9-9a11-a47a476b8f2a tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:06.559330 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-41f8c67c-f759-40e9-9a11-a47a476b8f2a tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:06.787442 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:59:06.897175 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-41f8c67c-f759-40e9-9a11-a47a476b8f2a tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "POST /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.355291 Sep 20 04:59:06.898305 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 465/615] 10.222.0.27 () {62 vars in 1364 bytes} [Tue Sep 20 04:59:06 2022] POST /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7/os-volume_attachments => generated 188 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 20 04:59:06.903561 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-5300a5af-8d3c-472a-ada9-0dff625c0700 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:59:06.904178 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-5300a5af-8d3c-472a-ada9-0dff625c0700 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: cd514882-49cd-4d14-a8e1-b17b0605cd1f] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:59:06.912401 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5300a5af-8d3c-472a-ada9-0dff625c0700 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:06.913038 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5300a5af-8d3c-472a-ada9-0dff625c0700 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:06.915539 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5300a5af-8d3c-472a-ada9-0dff625c0700 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:06.915539 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5300a5af-8d3c-472a-ada9-0dff625c0700 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:06.915539 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5300a5af-8d3c-472a-ada9-0dff625c0700 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:06.915907 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5300a5af-8d3c-472a-ada9-0dff625c0700 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:07.062449 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-5300a5af-8d3c-472a-ada9-0dff625c0700 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:07.071599 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-5300a5af-8d3c-472a-ada9-0dff625c0700 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/cd514882-49cd-4d14-a8e1-b17b0605cd1f" status: 200 len: 1265 microversion: 2.1 time: 0.171584 Sep 20 04:59:07.072474 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 466/616] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:59:06 2022] GET /compute/v2.1/servers/cd514882-49cd-4d14-a8e1-b17b0605cd1f => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 04:59:07.077441 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-12aedfd3-67ea-48a4-8f18-e853df03ec6c req-b388f672-fc6c-423f-9db7-baecc66eb5b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd514882-49cd-4d14-a8e1-b17b0605cd1f", "name": "network-vif-plugged", "status": "completed", "tag": "cdc3a8f8-3815-44e2-8784-9ad2e03e2914"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:59:07.088978 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-12aedfd3-67ea-48a4-8f18-e853df03ec6c req-b388f672-fc6c-423f-9db7-baecc66eb5b2 service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:07.089450 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-12aedfd3-67ea-48a4-8f18-e853df03ec6c req-b388f672-fc6c-423f-9db7-baecc66eb5b2 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:07.089870 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-12aedfd3-67ea-48a4-8f18-e853df03ec6c req-b388f672-fc6c-423f-9db7-baecc66eb5b2 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:07.102213 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-12aedfd3-67ea-48a4-8f18-e853df03ec6c req-b388f672-fc6c-423f-9db7-baecc66eb5b2 service nova] Creating event network-vif-plugged:cdc3a8f8-3815-44e2-8784-9ad2e03e2914 for instance cd514882-49cd-4d14-a8e1-b17b0605cd1f on hv-cinder-75671 Sep 20 04:59:07.108265 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-12aedfd3-67ea-48a4-8f18-e853df03ec6c req-b388f672-fc6c-423f-9db7-baecc66eb5b2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034556 Sep 20 04:59:07.108958 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 467/617] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 04:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 04:59:07.114402 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-c0284392-4e98-45a8-af9e-50d690da4214 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:59:07.115153 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-c0284392-4e98-45a8-af9e-50d690da4214 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:59:07.121388 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c0284392-4e98-45a8-af9e-50d690da4214 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:07.121933 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c0284392-4e98-45a8-af9e-50d690da4214 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:07.122369 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c0284392-4e98-45a8-af9e-50d690da4214 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:07.123057 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c0284392-4e98-45a8-af9e-50d690da4214 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:07.123529 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c0284392-4e98-45a8-af9e-50d690da4214 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:07.123931 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c0284392-4e98-45a8-af9e-50d690da4214 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:07.174315 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-c0284392-4e98-45a8-af9e-50d690da4214 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126813) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 20 04:59:07.393373 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-c0284392-4e98-45a8-af9e-50d690da4214 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "POST /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7/action" status: 202 len: 0 microversion: 2.20 time: 0.283125 Sep 20 04:59:07.397329 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 468/618] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Sep 20 04:59:07 2022] POST /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 20 04:59:07.403405 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-0a07e5a7-6912-40ed-bf7a-f09aa6b7d2b5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:59:07.404094 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-0a07e5a7-6912-40ed-bf7a-f09aa6b7d2b5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:59:07.411470 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0a07e5a7-6912-40ed-bf7a-f09aa6b7d2b5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:07.412216 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0a07e5a7-6912-40ed-bf7a-f09aa6b7d2b5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:07.412370 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0a07e5a7-6912-40ed-bf7a-f09aa6b7d2b5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:07.413117 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0a07e5a7-6912-40ed-bf7a-f09aa6b7d2b5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:07.413612 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0a07e5a7-6912-40ed-bf7a-f09aa6b7d2b5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:07.414107 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0a07e5a7-6912-40ed-bf7a-f09aa6b7d2b5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:07.548295 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-0a07e5a7-6912-40ed-bf7a-f09aa6b7d2b5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:07.557459 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-0a07e5a7-6912-40ed-bf7a-f09aa6b7d2b5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:07.558893 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-0a07e5a7-6912-40ed-bf7a-f09aa6b7d2b5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:07.560042 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-0a07e5a7-6912-40ed-bf7a-f09aa6b7d2b5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1749 microversion: 2.20 time: 0.162045 Sep 20 04:59:07.560592 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 469/619] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:59:07 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1749 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 04:59:08.095208 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-f57426ae-bb5d-4c32-96fb-f11a040793ac tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:59:08.095959 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-f57426ae-bb5d-4c32-96fb-f11a040793ac tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: cd514882-49cd-4d14-a8e1-b17b0605cd1f] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:59:08.102710 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f57426ae-bb5d-4c32-96fb-f11a040793ac tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:08.103384 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f57426ae-bb5d-4c32-96fb-f11a040793ac tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:08.103979 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f57426ae-bb5d-4c32-96fb-f11a040793ac tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:08.104797 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f57426ae-bb5d-4c32-96fb-f11a040793ac tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:08.105281 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f57426ae-bb5d-4c32-96fb-f11a040793ac tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:08.105730 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f57426ae-bb5d-4c32-96fb-f11a040793ac tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:08.251226 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-f57426ae-bb5d-4c32-96fb-f11a040793ac tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:08.259988 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-f57426ae-bb5d-4c32-96fb-f11a040793ac tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/cd514882-49cd-4d14-a8e1-b17b0605cd1f" status: 200 len: 1265 microversion: 2.1 time: 0.168589 Sep 20 04:59:08.260557 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 470/620] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:59:08 2022] GET /compute/v2.1/servers/cd514882-49cd-4d14-a8e1-b17b0605cd1f => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:59:08.585308 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-aba8fde8-877f-4254-8e94-c074dc14cdbc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:59:08.586551 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-aba8fde8-877f-4254-8e94-c074dc14cdbc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:59:08.592947 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-aba8fde8-877f-4254-8e94-c074dc14cdbc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:08.593429 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-aba8fde8-877f-4254-8e94-c074dc14cdbc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:08.593866 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-aba8fde8-877f-4254-8e94-c074dc14cdbc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:08.594553 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-aba8fde8-877f-4254-8e94-c074dc14cdbc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:08.595002 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-aba8fde8-877f-4254-8e94-c074dc14cdbc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:08.595428 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-aba8fde8-877f-4254-8e94-c074dc14cdbc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:08.726083 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-aba8fde8-877f-4254-8e94-c074dc14cdbc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:08.736241 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-aba8fde8-877f-4254-8e94-c074dc14cdbc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:08.737759 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-aba8fde8-877f-4254-8e94-c074dc14cdbc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:08.738927 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-aba8fde8-877f-4254-8e94-c074dc14cdbc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1749 microversion: 2.20 time: 0.157580 Sep 20 04:59:08.739658 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 471/621] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:59:08 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1749 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 04:59:09.123840 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-a2fcdf89-939e-4b79-a7f4-60870f6d8b65 req-c01b7163-7fa4-449f-a8bd-1ba585ea47c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dc0a271-e3e8-4883-b052-72a5c319c6b7", "name": "network-vif-unplugged", "status": "completed", "tag": "91a0df87-3f74-4106-92a9-e9a99f1cd365"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:59:09.134026 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-a2fcdf89-939e-4b79-a7f4-60870f6d8b65 req-c01b7163-7fa4-449f-a8bd-1ba585ea47c9 service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:09.134434 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-a2fcdf89-939e-4b79-a7f4-60870f6d8b65 req-c01b7163-7fa4-449f-a8bd-1ba585ea47c9 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:09.134870 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-a2fcdf89-939e-4b79-a7f4-60870f6d8b65 req-c01b7163-7fa4-449f-a8bd-1ba585ea47c9 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:09.146136 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.compute.server_external_events [req-a2fcdf89-939e-4b79-a7f4-60870f6d8b65 req-c01b7163-7fa4-449f-a8bd-1ba585ea47c9 service nova] Unable to find a host for instance 1dc0a271-e3e8-4883-b052-72a5c319c6b7. Dropping event network-vif-unplugged {{(pid=126813) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 20 04:59:09.147007 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-a2fcdf89-939e-4b79-a7f4-60870f6d8b65 req-c01b7163-7fa4-449f-a8bd-1ba585ea47c9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027021 Sep 20 04:59:09.147888 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 472/622] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 04:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 20 04:59:09.283353 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-92d26987-af05-4258-8095-22f926c4a5d4 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:59:09.283900 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-92d26987-af05-4258-8095-22f926c4a5d4 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: cd514882-49cd-4d14-a8e1-b17b0605cd1f] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:59:09.290443 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-92d26987-af05-4258-8095-22f926c4a5d4 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:09.290960 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-92d26987-af05-4258-8095-22f926c4a5d4 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:09.291385 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-92d26987-af05-4258-8095-22f926c4a5d4 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:09.292072 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-92d26987-af05-4258-8095-22f926c4a5d4 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:09.292528 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-92d26987-af05-4258-8095-22f926c4a5d4 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:09.292982 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-92d26987-af05-4258-8095-22f926c4a5d4 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:09.422848 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-92d26987-af05-4258-8095-22f926c4a5d4 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:09.431667 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-92d26987-af05-4258-8095-22f926c4a5d4 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/cd514882-49cd-4d14-a8e1-b17b0605cd1f" status: 200 len: 1453 microversion: 2.1 time: 0.152154 Sep 20 04:59:09.432322 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 473/623] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:59:09 2022] GET /compute/v2.1/servers/cd514882-49cd-4d14-a8e1-b17b0605cd1f => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:59:09.453582 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-d77f8d5c-532d-4b3e-b6d4-030514923606 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:59:09.454249 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-d77f8d5c-532d-4b3e-b6d4-030514923606 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: cd514882-49cd-4d14-a8e1-b17b0605cd1f] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:59:09.460004 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d77f8d5c-532d-4b3e-b6d4-030514923606 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:09.460481 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d77f8d5c-532d-4b3e-b6d4-030514923606 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:09.460944 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d77f8d5c-532d-4b3e-b6d4-030514923606 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:09.461626 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d77f8d5c-532d-4b3e-b6d4-030514923606 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:09.462069 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d77f8d5c-532d-4b3e-b6d4-030514923606 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:09.462505 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d77f8d5c-532d-4b3e-b6d4-030514923606 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:09.605381 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-d77f8d5c-532d-4b3e-b6d4-030514923606 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:09.613331 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-d77f8d5c-532d-4b3e-b6d4-030514923606 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/cd514882-49cd-4d14-a8e1-b17b0605cd1f" status: 200 len: 1453 microversion: 2.1 time: 0.163390 Sep 20 04:59:09.613891 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 474/624] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 04:59:09 2022] GET /compute/v2.1/servers/cd514882-49cd-4d14-a8e1-b17b0605cd1f => generated 1453 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 04:59:09.765360 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-f57dc2b6-cf60-4c3b-9c10-292fd2b4a6de tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:59:09.765974 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-f57dc2b6-cf60-4c3b-9c10-292fd2b4a6de tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:59:09.771927 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f57dc2b6-cf60-4c3b-9c10-292fd2b4a6de tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:09.772416 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f57dc2b6-cf60-4c3b-9c10-292fd2b4a6de tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:09.773400 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f57dc2b6-cf60-4c3b-9c10-292fd2b4a6de tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:09.774177 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f57dc2b6-cf60-4c3b-9c10-292fd2b4a6de tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:09.774661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f57dc2b6-cf60-4c3b-9c10-292fd2b4a6de tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:09.775123 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f57dc2b6-cf60-4c3b-9c10-292fd2b4a6de tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:09.920402 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-f57dc2b6-cf60-4c3b-9c10-292fd2b4a6de tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:09.936377 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-f57dc2b6-cf60-4c3b-9c10-292fd2b4a6de tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:09.938702 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-f57dc2b6-cf60-4c3b-9c10-292fd2b4a6de tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:09.939880 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-f57dc2b6-cf60-4c3b-9c10-292fd2b4a6de tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1751 microversion: 2.20 time: 0.179357 Sep 20 04:59:09.949316 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 475/625] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:59:09 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1751 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 04:59:10.966127 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-c275cce8-25b1-44f4-a613-34b7c623c7b1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:59:10.966999 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-c275cce8-25b1-44f4-a613-34b7c623c7b1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:59:10.974598 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c275cce8-25b1-44f4-a613-34b7c623c7b1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:10.975004 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c275cce8-25b1-44f4-a613-34b7c623c7b1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:10.975481 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c275cce8-25b1-44f4-a613-34b7c623c7b1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:10.976655 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c275cce8-25b1-44f4-a613-34b7c623c7b1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:10.977143 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c275cce8-25b1-44f4-a613-34b7c623c7b1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:10.977569 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c275cce8-25b1-44f4-a613-34b7c623c7b1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:11.161278 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-c275cce8-25b1-44f4-a613-34b7c623c7b1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:11.174042 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-c275cce8-25b1-44f4-a613-34b7c623c7b1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:11.176246 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-c275cce8-25b1-44f4-a613-34b7c623c7b1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:11.177490 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-c275cce8-25b1-44f4-a613-34b7c623c7b1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1807 microversion: 2.20 time: 0.215373 Sep 20 04:59:11.178288 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 476/626] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:59:10 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1807 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 04:59:12.198658 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-e462186e-4429-4c39-b3b4-71e33af71b57 req-efe87a5c-7b3a-475d-9702-6fe308aa258e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd514882-49cd-4d14-a8e1-b17b0605cd1f", "tag": "cdc3a8f8-3815-44e2-8784-9ad2e03e2914"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:59:12.225556 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-e462186e-4429-4c39-b3b4-71e33af71b57 req-efe87a5c-7b3a-475d-9702-6fe308aa258e service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:12.227535 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-e462186e-4429-4c39-b3b4-71e33af71b57 req-efe87a5c-7b3a-475d-9702-6fe308aa258e service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:12.228957 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-e462186e-4429-4c39-b3b4-71e33af71b57 req-efe87a5c-7b3a-475d-9702-6fe308aa258e service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:12.251192 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-e462186e-4429-4c39-b3b4-71e33af71b57 req-efe87a5c-7b3a-475d-9702-6fe308aa258e service nova] Creating event network-changed:cdc3a8f8-3815-44e2-8784-9ad2e03e2914 for instance cd514882-49cd-4d14-a8e1-b17b0605cd1f on hv-cinder-75671 Sep 20 04:59:12.258313 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-e462186e-4429-4c39-b3b4-71e33af71b57 req-efe87a5c-7b3a-475d-9702-6fe308aa258e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064908 Sep 20 04:59:12.260080 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 477/627] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 04:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 04:59:12.283480 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-3d752bb1-4096-4c55-bd50-82f6acd91ccd tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:59:12.283480 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-3d752bb1-4096-4c55-bd50-82f6acd91ccd tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:59:12.291123 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3d752bb1-4096-4c55-bd50-82f6acd91ccd tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:12.292800 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3d752bb1-4096-4c55-bd50-82f6acd91ccd tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:12.293599 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3d752bb1-4096-4c55-bd50-82f6acd91ccd tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:12.294462 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3d752bb1-4096-4c55-bd50-82f6acd91ccd tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:12.295074 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3d752bb1-4096-4c55-bd50-82f6acd91ccd tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:12.295733 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3d752bb1-4096-4c55-bd50-82f6acd91ccd tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:12.593886 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-3d752bb1-4096-4c55-bd50-82f6acd91ccd tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:12.612078 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-3d752bb1-4096-4c55-bd50-82f6acd91ccd tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:12.615099 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-3d752bb1-4096-4c55-bd50-82f6acd91ccd tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:12.619038 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-3d752bb1-4096-4c55-bd50-82f6acd91ccd tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1807 microversion: 2.20 time: 0.354584 Sep 20 04:59:12.619838 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 478/628] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:59:12 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1807 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 04:59:13.649643 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-1e76e84b-5755-437d-92e3-82ae5c1fb07a tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:59:13.650409 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-1e76e84b-5755-437d-92e3-82ae5c1fb07a tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:59:13.671169 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1e76e84b-5755-437d-92e3-82ae5c1fb07a tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:13.671669 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1e76e84b-5755-437d-92e3-82ae5c1fb07a tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:13.672111 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1e76e84b-5755-437d-92e3-82ae5c1fb07a tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:13.672873 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1e76e84b-5755-437d-92e3-82ae5c1fb07a tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:13.673311 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1e76e84b-5755-437d-92e3-82ae5c1fb07a tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:13.673740 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1e76e84b-5755-437d-92e3-82ae5c1fb07a tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:13.895113 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-1e76e84b-5755-437d-92e3-82ae5c1fb07a tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:13.908092 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-1e76e84b-5755-437d-92e3-82ae5c1fb07a tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:13.910889 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-1e76e84b-5755-437d-92e3-82ae5c1fb07a tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:13.912429 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-1e76e84b-5755-437d-92e3-82ae5c1fb07a tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1807 microversion: 2.20 time: 0.267790 Sep 20 04:59:13.914087 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 479/629] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:59:13 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1807 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 04:59:14.942399 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-b70e5a0a-2e10-4760-a990-4e185ce86a8e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:59:14.943277 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-b70e5a0a-2e10-4760-a990-4e185ce86a8e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:59:14.956034 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b70e5a0a-2e10-4760-a990-4e185ce86a8e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:14.956637 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b70e5a0a-2e10-4760-a990-4e185ce86a8e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:14.957148 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b70e5a0a-2e10-4760-a990-4e185ce86a8e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:14.957921 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b70e5a0a-2e10-4760-a990-4e185ce86a8e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:14.958445 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b70e5a0a-2e10-4760-a990-4e185ce86a8e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:14.958944 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b70e5a0a-2e10-4760-a990-4e185ce86a8e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:15.097761 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-b70e5a0a-2e10-4760-a990-4e185ce86a8e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:15.106389 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-b70e5a0a-2e10-4760-a990-4e185ce86a8e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:15.107865 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-b70e5a0a-2e10-4760-a990-4e185ce86a8e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:15.109059 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-b70e5a0a-2e10-4760-a990-4e185ce86a8e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1807 microversion: 2.20 time: 0.170896 Sep 20 04:59:15.109620 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 480/630] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:59:14 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 04:59:16.135336 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-f1ab5c1b-1bb5-4626-a45d-e3beedfe7f35 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:59:16.136115 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-f1ab5c1b-1bb5-4626-a45d-e3beedfe7f35 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:59:16.143430 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f1ab5c1b-1bb5-4626-a45d-e3beedfe7f35 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:16.143962 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f1ab5c1b-1bb5-4626-a45d-e3beedfe7f35 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:16.144538 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f1ab5c1b-1bb5-4626-a45d-e3beedfe7f35 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:16.145404 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f1ab5c1b-1bb5-4626-a45d-e3beedfe7f35 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:16.146108 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f1ab5c1b-1bb5-4626-a45d-e3beedfe7f35 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:16.146533 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f1ab5c1b-1bb5-4626-a45d-e3beedfe7f35 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:16.283859 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-f1ab5c1b-1bb5-4626-a45d-e3beedfe7f35 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:16.287437 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=93,nova_cell1:UPDATE=4 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:59:16.293834 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-f1ab5c1b-1bb5-4626-a45d-e3beedfe7f35 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:16.295279 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-f1ab5c1b-1bb5-4626-a45d-e3beedfe7f35 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:16.296433 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-f1ab5c1b-1bb5-4626-a45d-e3beedfe7f35 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1807 microversion: 2.20 time: 0.165041 Sep 20 04:59:16.297276 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 481/631] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:59:16 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 04:59:17.322311 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-ba538798-a059-4fef-8791-6c16d3a4dc53 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:59:17.323031 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-ba538798-a059-4fef-8791-6c16d3a4dc53 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:59:17.331528 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ba538798-a059-4fef-8791-6c16d3a4dc53 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:17.332045 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ba538798-a059-4fef-8791-6c16d3a4dc53 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:17.332481 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ba538798-a059-4fef-8791-6c16d3a4dc53 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:17.333205 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ba538798-a059-4fef-8791-6c16d3a4dc53 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:17.333654 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ba538798-a059-4fef-8791-6c16d3a4dc53 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:17.334077 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ba538798-a059-4fef-8791-6c16d3a4dc53 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:17.480664 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-ba538798-a059-4fef-8791-6c16d3a4dc53 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:17.489744 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-ba538798-a059-4fef-8791-6c16d3a4dc53 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:17.491195 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-ba538798-a059-4fef-8791-6c16d3a4dc53 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:17.492408 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-ba538798-a059-4fef-8791-6c16d3a4dc53 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1807 microversion: 2.20 time: 0.174186 Sep 20 04:59:17.492991 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 482/632] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:59:17 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 04:59:18.518658 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-29a64ae7-79d5-4c19-af4f-d2a9decf82e6 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:59:18.519371 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-29a64ae7-79d5-4c19-af4f-d2a9decf82e6 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:59:18.526968 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-29a64ae7-79d5-4c19-af4f-d2a9decf82e6 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:18.527455 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-29a64ae7-79d5-4c19-af4f-d2a9decf82e6 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:18.527889 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-29a64ae7-79d5-4c19-af4f-d2a9decf82e6 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:18.528670 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-29a64ae7-79d5-4c19-af4f-d2a9decf82e6 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:18.529124 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-29a64ae7-79d5-4c19-af4f-d2a9decf82e6 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:18.529549 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-29a64ae7-79d5-4c19-af4f-d2a9decf82e6 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:18.681037 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-29a64ae7-79d5-4c19-af4f-d2a9decf82e6 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:18.691167 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-29a64ae7-79d5-4c19-af4f-d2a9decf82e6 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:18.692775 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-29a64ae7-79d5-4c19-af4f-d2a9decf82e6 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:18.694104 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-29a64ae7-79d5-4c19-af4f-d2a9decf82e6 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1807 microversion: 2.20 time: 0.179269 Sep 20 04:59:18.708625 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 483/633] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:59:18 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1807 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 04:59:19.719415 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-2d9d8d31-6d65-4a03-a5c7-36b540a19ced tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:59:19.720104 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-2d9d8d31-6d65-4a03-a5c7-36b540a19ced tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:59:19.726785 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2d9d8d31-6d65-4a03-a5c7-36b540a19ced tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:19.727314 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2d9d8d31-6d65-4a03-a5c7-36b540a19ced tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:19.727713 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2d9d8d31-6d65-4a03-a5c7-36b540a19ced tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:19.728413 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2d9d8d31-6d65-4a03-a5c7-36b540a19ced tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:19.728897 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2d9d8d31-6d65-4a03-a5c7-36b540a19ced tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:19.729326 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2d9d8d31-6d65-4a03-a5c7-36b540a19ced tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:19.883036 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-2d9d8d31-6d65-4a03-a5c7-36b540a19ced tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:19.891937 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-2d9d8d31-6d65-4a03-a5c7-36b540a19ced tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:19.893517 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-2d9d8d31-6d65-4a03-a5c7-36b540a19ced tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:19.894773 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-2d9d8d31-6d65-4a03-a5c7-36b540a19ced tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1807 microversion: 2.20 time: 0.179192 Sep 20 04:59:19.895348 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 484/634] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:59:19 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 04:59:20.919436 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-559d39fa-a2d6-46db-8c23-8d36ee2c3ce9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:59:20.920091 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-559d39fa-a2d6-46db-8c23-8d36ee2c3ce9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:59:20.926460 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-559d39fa-a2d6-46db-8c23-8d36ee2c3ce9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:20.926932 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-559d39fa-a2d6-46db-8c23-8d36ee2c3ce9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:20.927361 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-559d39fa-a2d6-46db-8c23-8d36ee2c3ce9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:20.928064 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-559d39fa-a2d6-46db-8c23-8d36ee2c3ce9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:20.928508 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-559d39fa-a2d6-46db-8c23-8d36ee2c3ce9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:20.929470 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-559d39fa-a2d6-46db-8c23-8d36ee2c3ce9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:21.056707 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-559d39fa-a2d6-46db-8c23-8d36ee2c3ce9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:21.065438 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-559d39fa-a2d6-46db-8c23-8d36ee2c3ce9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:21.066885 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-559d39fa-a2d6-46db-8c23-8d36ee2c3ce9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:21.068040 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-559d39fa-a2d6-46db-8c23-8d36ee2c3ce9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1807 microversion: 2.20 time: 0.152600 Sep 20 04:59:21.068625 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 485/635] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:59:20 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 04:59:22.093972 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-b20de0ed-f603-4836-8e43-316776e7dff7 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:59:22.094586 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-b20de0ed-f603-4836-8e43-316776e7dff7 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:59:22.100939 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b20de0ed-f603-4836-8e43-316776e7dff7 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:22.101441 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b20de0ed-f603-4836-8e43-316776e7dff7 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:22.101884 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b20de0ed-f603-4836-8e43-316776e7dff7 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:22.102569 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b20de0ed-f603-4836-8e43-316776e7dff7 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:22.103023 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b20de0ed-f603-4836-8e43-316776e7dff7 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:22.103451 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b20de0ed-f603-4836-8e43-316776e7dff7 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:22.231190 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-b20de0ed-f603-4836-8e43-316776e7dff7 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:22.239749 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-b20de0ed-f603-4836-8e43-316776e7dff7 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:22.241235 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-b20de0ed-f603-4836-8e43-316776e7dff7 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:22.242390 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-b20de0ed-f603-4836-8e43-316776e7dff7 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1807 microversion: 2.20 time: 0.152439 Sep 20 04:59:22.242944 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 486/636] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:59:22 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 04:59:23.267832 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-1b5b3d20-3957-47dc-b7b8-4d71cc707b02 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:59:23.268571 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-1b5b3d20-3957-47dc-b7b8-4d71cc707b02 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:59:23.275176 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1b5b3d20-3957-47dc-b7b8-4d71cc707b02 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:23.275656 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1b5b3d20-3957-47dc-b7b8-4d71cc707b02 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:23.276090 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1b5b3d20-3957-47dc-b7b8-4d71cc707b02 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:23.276799 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1b5b3d20-3957-47dc-b7b8-4d71cc707b02 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:23.277250 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1b5b3d20-3957-47dc-b7b8-4d71cc707b02 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:23.277670 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1b5b3d20-3957-47dc-b7b8-4d71cc707b02 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:23.403317 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-1b5b3d20-3957-47dc-b7b8-4d71cc707b02 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:23.411926 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-1b5b3d20-3957-47dc-b7b8-4d71cc707b02 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:23.413371 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-1b5b3d20-3957-47dc-b7b8-4d71cc707b02 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:23.414534 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-1b5b3d20-3957-47dc-b7b8-4d71cc707b02 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1807 microversion: 2.20 time: 0.150804 Sep 20 04:59:23.415094 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 487/637] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:59:23 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 04:59:24.440198 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-9bb273c8-502c-4a92-9ee9-6fc664352aad tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:59:24.440887 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-9bb273c8-502c-4a92-9ee9-6fc664352aad tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:59:24.447764 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9bb273c8-502c-4a92-9ee9-6fc664352aad tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:24.448233 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9bb273c8-502c-4a92-9ee9-6fc664352aad tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:24.448702 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9bb273c8-502c-4a92-9ee9-6fc664352aad tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:24.449394 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9bb273c8-502c-4a92-9ee9-6fc664352aad tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:24.449851 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9bb273c8-502c-4a92-9ee9-6fc664352aad tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:24.450283 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9bb273c8-502c-4a92-9ee9-6fc664352aad tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:24.576923 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-9bb273c8-502c-4a92-9ee9-6fc664352aad tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:24.586037 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-9bb273c8-502c-4a92-9ee9-6fc664352aad tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:24.587486 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-9bb273c8-502c-4a92-9ee9-6fc664352aad tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:24.588667 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-9bb273c8-502c-4a92-9ee9-6fc664352aad tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1807 microversion: 2.20 time: 0.152410 Sep 20 04:59:24.589231 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 488/638] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:59:24 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 04:59:25.613590 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-447d8536-a40d-4283-b79b-f7ff353b1532 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:59:25.614216 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-447d8536-a40d-4283-b79b-f7ff353b1532 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:59:25.620833 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-447d8536-a40d-4283-b79b-f7ff353b1532 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:25.621318 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-447d8536-a40d-4283-b79b-f7ff353b1532 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:25.621755 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-447d8536-a40d-4283-b79b-f7ff353b1532 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:25.622443 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-447d8536-a40d-4283-b79b-f7ff353b1532 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:25.622893 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-447d8536-a40d-4283-b79b-f7ff353b1532 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:25.623320 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-447d8536-a40d-4283-b79b-f7ff353b1532 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:25.751397 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-447d8536-a40d-4283-b79b-f7ff353b1532 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:25.759944 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-447d8536-a40d-4283-b79b-f7ff353b1532 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:25.761450 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-447d8536-a40d-4283-b79b-f7ff353b1532 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:25.762607 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-447d8536-a40d-4283-b79b-f7ff353b1532 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1807 microversion: 2.20 time: 0.152951 Sep 20 04:59:25.763167 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 489/639] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:59:25 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 04:59:26.788990 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-c3be1823-6e03-4573-9abb-60c5e5c5b0f5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:59:26.789659 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-c3be1823-6e03-4573-9abb-60c5e5c5b0f5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:59:26.795555 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c3be1823-6e03-4573-9abb-60c5e5c5b0f5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:26.796029 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c3be1823-6e03-4573-9abb-60c5e5c5b0f5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:26.796457 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c3be1823-6e03-4573-9abb-60c5e5c5b0f5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:26.797162 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c3be1823-6e03-4573-9abb-60c5e5c5b0f5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:26.797606 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c3be1823-6e03-4573-9abb-60c5e5c5b0f5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:26.798024 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c3be1823-6e03-4573-9abb-60c5e5c5b0f5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:26.924509 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-c3be1823-6e03-4573-9abb-60c5e5c5b0f5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:26.933564 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-c3be1823-6e03-4573-9abb-60c5e5c5b0f5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:26.934994 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-c3be1823-6e03-4573-9abb-60c5e5c5b0f5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:26.936134 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-c3be1823-6e03-4573-9abb-60c5e5c5b0f5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1807 microversion: 2.20 time: 0.151759 Sep 20 04:59:26.936712 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 490/640] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:59:26 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 04:59:27.960703 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-f134ec06-92ea-4df6-a93e-803c518d2ac1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:59:27.961313 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-f134ec06-92ea-4df6-a93e-803c518d2ac1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:59:27.967670 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f134ec06-92ea-4df6-a93e-803c518d2ac1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:27.968152 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f134ec06-92ea-4df6-a93e-803c518d2ac1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:27.968589 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f134ec06-92ea-4df6-a93e-803c518d2ac1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:27.969294 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f134ec06-92ea-4df6-a93e-803c518d2ac1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:27.969744 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f134ec06-92ea-4df6-a93e-803c518d2ac1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:27.970166 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f134ec06-92ea-4df6-a93e-803c518d2ac1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:28.097195 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-f134ec06-92ea-4df6-a93e-803c518d2ac1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:28.106173 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-f134ec06-92ea-4df6-a93e-803c518d2ac1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:28.107616 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-f134ec06-92ea-4df6-a93e-803c518d2ac1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:28.108806 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-f134ec06-92ea-4df6-a93e-803c518d2ac1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1807 microversion: 2.20 time: 0.152017 Sep 20 04:59:28.109362 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 491/641] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:59:27 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 04:59:29.133692 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-654bed16-c5bc-490d-96da-8c8a9941aa03 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:59:29.134306 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-654bed16-c5bc-490d-96da-8c8a9941aa03 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:59:29.140914 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-654bed16-c5bc-490d-96da-8c8a9941aa03 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:29.141402 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-654bed16-c5bc-490d-96da-8c8a9941aa03 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:29.141837 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-654bed16-c5bc-490d-96da-8c8a9941aa03 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:29.142535 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-654bed16-c5bc-490d-96da-8c8a9941aa03 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:29.142987 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-654bed16-c5bc-490d-96da-8c8a9941aa03 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:29.143463 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-654bed16-c5bc-490d-96da-8c8a9941aa03 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:29.271195 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-654bed16-c5bc-490d-96da-8c8a9941aa03 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:29.280155 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-654bed16-c5bc-490d-96da-8c8a9941aa03 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:29.281626 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-654bed16-c5bc-490d-96da-8c8a9941aa03 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:29.282774 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-654bed16-c5bc-490d-96da-8c8a9941aa03 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1807 microversion: 2.20 time: 0.153184 Sep 20 04:59:29.283327 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 492/642] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:59:29 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 04:59:30.307975 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-7e67d011-9f18-4f5f-9a5f-862282772162 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:59:30.308590 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-7e67d011-9f18-4f5f-9a5f-862282772162 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:59:30.315032 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7e67d011-9f18-4f5f-9a5f-862282772162 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:30.315513 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7e67d011-9f18-4f5f-9a5f-862282772162 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:30.315951 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7e67d011-9f18-4f5f-9a5f-862282772162 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:30.316654 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7e67d011-9f18-4f5f-9a5f-862282772162 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:30.317109 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7e67d011-9f18-4f5f-9a5f-862282772162 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:30.317529 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7e67d011-9f18-4f5f-9a5f-862282772162 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:30.443856 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-7e67d011-9f18-4f5f-9a5f-862282772162 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:30.452979 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-7e67d011-9f18-4f5f-9a5f-862282772162 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:30.454419 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-7e67d011-9f18-4f5f-9a5f-862282772162 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:30.455571 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-7e67d011-9f18-4f5f-9a5f-862282772162 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1807 microversion: 2.20 time: 0.151469 Sep 20 04:59:30.456127 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 493/643] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:59:30 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 04:59:30.700728 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-28014670-4fc5-4a60-afb4-ad3700f0686b req-38b4ca30-7887-47c9-8c1b-a2a70e280c8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dc0a271-e3e8-4883-b052-72a5c319c6b7", "name": "network-vif-plugged", "status": "completed", "tag": "91a0df87-3f74-4106-92a9-e9a99f1cd365"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 04:59:30.710131 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-28014670-4fc5-4a60-afb4-ad3700f0686b req-38b4ca30-7887-47c9-8c1b-a2a70e280c8b service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:30.710608 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-28014670-4fc5-4a60-afb4-ad3700f0686b req-38b4ca30-7887-47c9-8c1b-a2a70e280c8b service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:30.711038 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-28014670-4fc5-4a60-afb4-ad3700f0686b req-38b4ca30-7887-47c9-8c1b-a2a70e280c8b service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:30.722360 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-28014670-4fc5-4a60-afb4-ad3700f0686b req-38b4ca30-7887-47c9-8c1b-a2a70e280c8b service nova] Creating event network-vif-plugged:91a0df87-3f74-4106-92a9-e9a99f1cd365 for instance 1dc0a271-e3e8-4883-b052-72a5c319c6b7 on hv-cinder-75671 Sep 20 04:59:30.727346 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-28014670-4fc5-4a60-afb4-ad3700f0686b req-38b4ca30-7887-47c9-8c1b-a2a70e280c8b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030322 Sep 20 04:59:30.728000 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 494/644] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 04:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 04:59:31.483456 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-41942055-1d7c-467d-8dd1-37c6967213f5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:59:31.484090 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-41942055-1d7c-467d-8dd1-37c6967213f5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:59:31.490226 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-41942055-1d7c-467d-8dd1-37c6967213f5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:31.490707 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-41942055-1d7c-467d-8dd1-37c6967213f5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:31.491140 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-41942055-1d7c-467d-8dd1-37c6967213f5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:31.491824 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-41942055-1d7c-467d-8dd1-37c6967213f5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:31.492313 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-41942055-1d7c-467d-8dd1-37c6967213f5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:31.492777 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-41942055-1d7c-467d-8dd1-37c6967213f5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:31.625973 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-41942055-1d7c-467d-8dd1-37c6967213f5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:31.634895 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-41942055-1d7c-467d-8dd1-37c6967213f5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:31.636361 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-41942055-1d7c-467d-8dd1-37c6967213f5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:31.637584 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-41942055-1d7c-467d-8dd1-37c6967213f5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1807 microversion: 2.20 time: 0.158949 Sep 20 04:59:31.638140 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 495/645] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:59:31 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 04:59:32.663625 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-91251d70-1df7-4176-9db2-59f16e7aac91 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:59:32.664425 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-91251d70-1df7-4176-9db2-59f16e7aac91 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:59:32.671301 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-91251d70-1df7-4176-9db2-59f16e7aac91 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:32.671783 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-91251d70-1df7-4176-9db2-59f16e7aac91 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:32.672215 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-91251d70-1df7-4176-9db2-59f16e7aac91 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:32.672918 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-91251d70-1df7-4176-9db2-59f16e7aac91 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:32.673371 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-91251d70-1df7-4176-9db2-59f16e7aac91 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:32.673794 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-91251d70-1df7-4176-9db2-59f16e7aac91 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:32.815337 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-91251d70-1df7-4176-9db2-59f16e7aac91 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:32.824244 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-91251d70-1df7-4176-9db2-59f16e7aac91 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:32.825821 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-91251d70-1df7-4176-9db2-59f16e7aac91 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:32.827134 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-91251d70-1df7-4176-9db2-59f16e7aac91 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1807 microversion: 2.20 time: 0.167875 Sep 20 04:59:32.827779 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 496/646] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:59:32 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 04:59:33.852421 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-e363cd6c-7a52-4f4c-8e20-2bff110ab0c2 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 04:59:33.853141 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-e363cd6c-7a52-4f4c-8e20-2bff110ab0c2 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 04:59:33.859461 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e363cd6c-7a52-4f4c-8e20-2bff110ab0c2 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:33.859934 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e363cd6c-7a52-4f4c-8e20-2bff110ab0c2 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:33.860366 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e363cd6c-7a52-4f4c-8e20-2bff110ab0c2 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:33.861071 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e363cd6c-7a52-4f4c-8e20-2bff110ab0c2 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 04:59:33.861518 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e363cd6c-7a52-4f4c-8e20-2bff110ab0c2 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 04:59:33.861951 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e363cd6c-7a52-4f4c-8e20-2bff110ab0c2 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 04:59:34.007257 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-e363cd6c-7a52-4f4c-8e20-2bff110ab0c2 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:34.017085 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-e363cd6c-7a52-4f4c-8e20-2bff110ab0c2 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:34.018609 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-e363cd6c-7a52-4f4c-8e20-2bff110ab0c2 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 04:59:34.019807 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-e363cd6c-7a52-4f4c-8e20-2bff110ab0c2 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1794 microversion: 2.20 time: 0.171288 Sep 20 04:59:34.020390 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 497/647] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 04:59:33 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1794 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 05:00:06.509275 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-565208f3-2817-495b-8147-8541645f8dc5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:00:06.510003 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-565208f3-2817-495b-8147-8541645f8dc5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:00:06.512073 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:00:06.512752 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell1:SELECT=92 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:00:06.519771 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-565208f3-2817-495b-8147-8541645f8dc5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:06.520264 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-565208f3-2817-495b-8147-8541645f8dc5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:06.520866 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-565208f3-2817-495b-8147-8541645f8dc5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:06.521571 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-565208f3-2817-495b-8147-8541645f8dc5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:06.522060 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-565208f3-2817-495b-8147-8541645f8dc5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:06.522494 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-565208f3-2817-495b-8147-8541645f8dc5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:06.553167 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-565208f3-2817-495b-8147-8541645f8dc5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7/os-volume_attachments/1139fa08-8a21-401a-8788-deded4967932" status: 200 len: 194 microversion: 2.20 time: 0.048630 Sep 20 05:00:06.553749 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 498/648] 10.222.0.27 () {60 vars in 1454 bytes} [Tue Sep 20 05:00:06 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7/os-volume_attachments/1139fa08-8a21-401a-8788-deded4967932 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 20 05:00:06.624223 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-b8c5845f-fe09-452f-9973-8322c393bb7c tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:00:06.624748 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-b8c5845f-fe09-452f-9973-8322c393bb7c tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:00:06.630598 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b8c5845f-fe09-452f-9973-8322c393bb7c tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:06.631070 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b8c5845f-fe09-452f-9973-8322c393bb7c tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:06.631504 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b8c5845f-fe09-452f-9973-8322c393bb7c tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:06.632178 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b8c5845f-fe09-452f-9973-8322c393bb7c tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:06.633282 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b8c5845f-fe09-452f-9973-8322c393bb7c tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:06.633709 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b8c5845f-fe09-452f-9973-8322c393bb7c tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:06.711507 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.objects.instance [None req-b8c5845f-fe09-452f-9973-8322c393bb7c tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lazy-loading 'services' on Instance uuid 1dc0a271-e3e8-4883-b052-72a5c319c6b7 {{(pid=126813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 05:00:06.782472 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-b8c5845f-fe09-452f-9973-8322c393bb7c tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7/os-volume_attachments/1139fa08-8a21-401a-8788-deded4967932" status: 202 len: 0 microversion: 2.20 time: 0.162024 Sep 20 05:00:06.783079 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 499/649] 10.222.0.27 () {60 vars in 1457 bytes} [Tue Sep 20 05:00:06 2022] DELETE /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7/os-volume_attachments/1139fa08-8a21-401a-8788-deded4967932 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 20 05:00:06.793644 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-a8a75299-ecd0-44b9-9550-3f4c43dbe662 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:00:06.797012 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-a8a75299-ecd0-44b9-9550-3f4c43dbe662 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:00:06.810219 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a8a75299-ecd0-44b9-9550-3f4c43dbe662 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:06.810710 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a8a75299-ecd0-44b9-9550-3f4c43dbe662 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:06.811141 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a8a75299-ecd0-44b9-9550-3f4c43dbe662 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:06.811853 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a8a75299-ecd0-44b9-9550-3f4c43dbe662 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:06.812289 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a8a75299-ecd0-44b9-9550-3f4c43dbe662 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:06.812749 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a8a75299-ecd0-44b9-9550-3f4c43dbe662 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:06.843753 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-a8a75299-ecd0-44b9-9550-3f4c43dbe662 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056227 Sep 20 05:00:06.844324 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 500/650] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Sep 20 05:00:06 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 20 05:00:07.857327 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-675cdd2b-f14f-4814-b8db-80f997938bf0 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:00:07.859489 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-675cdd2b-f14f-4814-b8db-80f997938bf0 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:00:07.866020 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-675cdd2b-f14f-4814-b8db-80f997938bf0 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:07.866498 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-675cdd2b-f14f-4814-b8db-80f997938bf0 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:07.867607 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-675cdd2b-f14f-4814-b8db-80f997938bf0 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:07.868343 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-675cdd2b-f14f-4814-b8db-80f997938bf0 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:07.868851 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-675cdd2b-f14f-4814-b8db-80f997938bf0 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:07.869279 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-675cdd2b-f14f-4814-b8db-80f997938bf0 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:07.898024 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-675cdd2b-f14f-4814-b8db-80f997938bf0 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044823 Sep 20 05:00:07.898630 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 501/651] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Sep 20 05:00:07 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:00:07.964955 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-449393fc-6d47-407a-94d4-c8186c58baf4 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:00:07.965460 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-449393fc-6d47-407a-94d4-c8186c58baf4 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:00:07.971426 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-449393fc-6d47-407a-94d4-c8186c58baf4 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:07.971911 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-449393fc-6d47-407a-94d4-c8186c58baf4 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:07.972351 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-449393fc-6d47-407a-94d4-c8186c58baf4 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:07.973075 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-449393fc-6d47-407a-94d4-c8186c58baf4 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:07.973531 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-449393fc-6d47-407a-94d4-c8186c58baf4 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:07.973959 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-449393fc-6d47-407a-94d4-c8186c58baf4 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:08.001085 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-449393fc-6d47-407a-94d4-c8186c58baf4 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Going to try to terminate instance {{(pid=126813) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 20 05:00:08.075513 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-449393fc-6d47-407a-94d4-c8186c58baf4 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 204 len: 0 microversion: 2.20 time: 0.113528 Sep 20 05:00:08.076109 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 502/652] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Sep 20 05:00:07 2022] DELETE /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 20 05:00:08.084656 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-dfec066f-a1d6-4279-900b-3d1d384ddb77 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:00:08.085351 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-dfec066f-a1d6-4279-900b-3d1d384ddb77 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:00:08.091092 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-dfec066f-a1d6-4279-900b-3d1d384ddb77 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:08.091576 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-dfec066f-a1d6-4279-900b-3d1d384ddb77 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:08.092011 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-dfec066f-a1d6-4279-900b-3d1d384ddb77 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:08.092721 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-dfec066f-a1d6-4279-900b-3d1d384ddb77 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:08.093176 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-dfec066f-a1d6-4279-900b-3d1d384ddb77 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:08.093603 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-dfec066f-a1d6-4279-900b-3d1d384ddb77 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:08.221482 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-dfec066f-a1d6-4279-900b-3d1d384ddb77 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:00:08.230219 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-dfec066f-a1d6-4279-900b-3d1d384ddb77 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:00:08.231684 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-dfec066f-a1d6-4279-900b-3d1d384ddb77 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:00:08.232860 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-dfec066f-a1d6-4279-900b-3d1d384ddb77 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1722 microversion: 2.20 time: 0.152173 Sep 20 05:00:08.233407 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 503/653] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:00:08 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 05:00:09.257283 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-a86c8f2f-b986-4b31-bdb2-6c4e089f7df2 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:00:09.257941 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-a86c8f2f-b986-4b31-bdb2-6c4e089f7df2 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:00:09.264554 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a86c8f2f-b986-4b31-bdb2-6c4e089f7df2 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:09.265066 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a86c8f2f-b986-4b31-bdb2-6c4e089f7df2 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:09.265496 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a86c8f2f-b986-4b31-bdb2-6c4e089f7df2 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:09.266167 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a86c8f2f-b986-4b31-bdb2-6c4e089f7df2 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:09.266612 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a86c8f2f-b986-4b31-bdb2-6c4e089f7df2 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:09.267030 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a86c8f2f-b986-4b31-bdb2-6c4e089f7df2 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:09.398641 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-a86c8f2f-b986-4b31-bdb2-6c4e089f7df2 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:00:09.407001 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-a86c8f2f-b986-4b31-bdb2-6c4e089f7df2 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:00:09.408392 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-a86c8f2f-b986-4b31-bdb2-6c4e089f7df2 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:00:09.409574 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-a86c8f2f-b986-4b31-bdb2-6c4e089f7df2 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1722 microversion: 2.20 time: 0.156193 Sep 20 05:00:09.410129 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 504/654] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:00:09 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 05:00:10.435892 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-2b0f38d4-f01f-4f7f-bf42-7cad6ed2ebbe tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:00:10.436581 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-2b0f38d4-f01f-4f7f-bf42-7cad6ed2ebbe tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:00:10.443119 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2b0f38d4-f01f-4f7f-bf42-7cad6ed2ebbe tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:10.443600 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2b0f38d4-f01f-4f7f-bf42-7cad6ed2ebbe tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:10.444037 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2b0f38d4-f01f-4f7f-bf42-7cad6ed2ebbe tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:10.444757 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2b0f38d4-f01f-4f7f-bf42-7cad6ed2ebbe tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:10.445819 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2b0f38d4-f01f-4f7f-bf42-7cad6ed2ebbe tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:10.446284 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2b0f38d4-f01f-4f7f-bf42-7cad6ed2ebbe tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:10.506164 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-2b0f38d4-f01f-4f7f-bf42-7cad6ed2ebbe tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:00:10.515067 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-2b0f38d4-f01f-4f7f-bf42-7cad6ed2ebbe tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:00:10.516507 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-2b0f38d4-f01f-4f7f-bf42-7cad6ed2ebbe tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:00:10.517686 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-2b0f38d4-f01f-4f7f-bf42-7cad6ed2ebbe tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 200 len: 1655 microversion: 2.20 time: 0.085807 Sep 20 05:00:10.518284 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 505/655] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:00:10 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 1655 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 05:00:10.577593 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-65b6feca-f446-4870-96bd-772e327115cc req-97db9436-b77b-4904-b616-a0e12f8d7470 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dc0a271-e3e8-4883-b052-72a5c319c6b7", "name": "network-vif-deleted", "tag": "91a0df87-3f74-4106-92a9-e9a99f1cd365"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:00:10.587623 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-65b6feca-f446-4870-96bd-772e327115cc req-97db9436-b77b-4904-b616-a0e12f8d7470 service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:10.588196 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-65b6feca-f446-4870-96bd-772e327115cc req-97db9436-b77b-4904-b616-a0e12f8d7470 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:10.588730 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-65b6feca-f446-4870-96bd-772e327115cc req-97db9436-b77b-4904-b616-a0e12f8d7470 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:10.609455 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-65b6feca-f446-4870-96bd-772e327115cc req-97db9436-b77b-4904-b616-a0e12f8d7470 service nova] Creating event network-vif-deleted:91a0df87-3f74-4106-92a9-e9a99f1cd365 for instance 1dc0a271-e3e8-4883-b052-72a5c319c6b7 on hv-cinder-75671 Sep 20 05:00:10.616449 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-65b6feca-f446-4870-96bd-772e327115cc req-97db9436-b77b-4904-b616-a0e12f8d7470 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042822 Sep 20 05:00:10.617651 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 506/656] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 05:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 05:00:11.543871 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-1d151b2a-b7ad-4914-9d41-0534c5e0934b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:00:11.544592 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-1d151b2a-b7ad-4914-9d41-0534c5e0934b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:00:11.550800 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1d151b2a-b7ad-4914-9d41-0534c5e0934b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:11.551280 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1d151b2a-b7ad-4914-9d41-0534c5e0934b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:11.551721 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1d151b2a-b7ad-4914-9d41-0534c5e0934b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:11.552406 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1d151b2a-b7ad-4914-9d41-0534c5e0934b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:11.552907 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1d151b2a-b7ad-4914-9d41-0534c5e0934b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:11.553334 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1d151b2a-b7ad-4914-9d41-0534c5e0934b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:11.566514 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.wsgi [None req-1d151b2a-b7ad-4914-9d41-0534c5e0934b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] HTTP exception thrown: Instance 1dc0a271-e3e8-4883-b052-72a5c319c6b7 could not be found. Sep 20 05:00:11.568134 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-1d151b2a-b7ad-4914-9d41-0534c5e0934b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Request method failure captured: Sep 20 05:00:11.568134 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: request: GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 HTTP/1.1 Sep 20 05:00:11.568134 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept: application/json Sep 20 05:00:11.568134 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept-Encoding: identity Sep 20 05:00:11.568134 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Connection: close Sep 20 05:00:11.568134 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Length: 0 Sep 20 05:00:11.568134 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Type: application/json Sep 20 05:00:11.568134 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Host: 10.222.0.27 Sep 20 05:00:11.568134 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Openstack-System-Scope: None Sep 20 05:00:11.568134 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: User-Agent: python-urllib3/1.26.12 Sep 20 05:00:11.568134 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Auth-Token: gAAAAABjKUhDVBHaSpNACo82MHQ488h9Hz6V238eHIgRuUiiTwfqDQF6wao0qjXI0FwBIjNyQ6oysjhAo1Odz8q7TrY8h1D3GP2ImwzuG616a9u9M6ilutBilZvjrydf0Z6X_jyetyJ5crDl6VWYL8XBjC9GHNcdNMdpo2vdAF1KJSW6LbunlUE Sep 20 05:00:11.568134 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Id: None Sep 20 05:00:11.568134 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Name: None Sep 20 05:00:11.568134 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Identity-Status: Confirmed Sep 20 05:00:11.568134 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Is-Admin-Project: True Sep 20 05:00:11.568134 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Openstack-Nova-Api-Version: 2.20 Sep 20 05:00:11.568134 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Id: default Sep 20 05:00:11.568134 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Name: Default Sep 20 05:00:11.568134 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Id: 56047142d69c4c1cbfa9f6a278622332 Sep 20 05:00:11.568134 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-104428247 Sep 20 05:00:11.568134 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Role: reader,member Sep 20 05:00:11.568134 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Roles: reader,member Sep 20 05:00:11.570379 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/56047142d69c4c1cbfa9f6a278622332"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/56047142d69c4c1cbfa9f6a278622332"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_56047142d69c4c1cbfa9f6a278622332", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/56047142d69c4c1cbfa9f6a278622332"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 05:00:11.570379 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant: tempest-AttachVolumeShelveTestJSON-104428247 Sep 20 05:00:11.570379 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Id: 56047142d69c4c1cbfa9f6a278622332 Sep 20 05:00:11.570379 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-104428247 Sep 20 05:00:11.570379 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User: tempest-AttachVolumeShelveTestJSON-104428247-project Sep 20 05:00:11.570379 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Id: default Sep 20 05:00:11.570379 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Name: Default Sep 20 05:00:11.570379 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Id: 32cbf88b156745ae9a59e8f795e8ef58 Sep 20 05:00:11.570379 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Name: tempest-AttachVolumeShelveTestJSON-104428247-project Sep 20 05:00:11.570379 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: method: > Sep 20 05:00:11.570379 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: exception: Instance 1dc0a271-e3e8-4883-b052-72a5c319c6b7 could not be found. Sep 20 05:00:11.570379 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: action_args: {'id': '1dc0a271-e3e8-4883-b052-72a5c319c6b7'} Sep 20 05:00:11.571380 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 05:00:11.571380 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:00:11.571380 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 05:00:11.571380 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 05:00:11.571380 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 05:00:11.571380 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 05:00:11.571380 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 05:00:11.571380 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 05:00:11.571380 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 05:00:11.571380 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 05:00:11.571380 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1dc0a271-e3e8-4883-b052-72a5c319c6b7 could not be found. Sep 20 05:00:11.571380 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:00:11.571380 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 05:00:11.571380 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:00:11.571380 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:00:11.571380 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 05:00:11.571380 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 05:00:11.571380 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 05:00:11.571380 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 05:00:11.571380 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 05:00:11.572990 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 05:00:11.572990 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 05:00:11.572990 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 05:00:11.572990 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 05:00:11.572990 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 05:00:11.572990 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 05:00:11.572990 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 05:00:11.572990 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dc0a271-e3e8-4883-b052-72a5c319c6b7 could not be found. Sep 20 05:00:11.572990 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:00:11.572990 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 05:00:11.572990 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:00:11.572990 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:00:11.572990 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 05:00:11.572990 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 05:00:11.572990 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 05:00:11.572990 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 05:00:11.572990 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dc0a271-e3e8-4883-b052-72a5c319c6b7 could not be found. Sep 20 05:00:11.572990 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:00:11.574421 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-1d151b2a-b7ad-4914-9d41-0534c5e0934b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Returning 404 to user: Instance 1dc0a271-e3e8-4883-b052-72a5c319c6b7 could not be found. {{(pid=126813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 05:00:11.574421 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-1d151b2a-b7ad-4914-9d41-0534c5e0934b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 404 len: 111 microversion: 2.20 time: 0.030393 Sep 20 05:00:11.574421 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 507/657] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:00:11 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 20 05:00:11.578220 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-850bb414-3652-45ab-91a7-635b3aec421c tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '.version_select at 0x7f2e4a531e50>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:00:11.597161 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-850bb414-3652-45ab-91a7-635b3aec421c tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-966651511" status: 204 len: 0 microversion: 2.20 time: 0.022208 Sep 20 05:00:11.597642 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 508/658] 10.222.0.27 () {60 vars in 1259 bytes} [Tue Sep 20 05:00:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-966651511 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 20 05:00:12.214833 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-7397caf7-85cb-4675-af81-b749822721ea tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Action: 'create', calling method: .version_select at 0x7f2e4a4f9af0>, body: {"keypair": {"name": "tempest-keypair-182015166", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAhiF6xxTodGc2j4L5BKMJWDs+2WfOuRwC1gTYTBS2dqH9ZjT4w2TXKoy6pyr85cveSqvxbXz6BJNJ6EiEDwzKRbOTlba0MNnRZelSNpQ09d25pR6zqzOh6uhVTDO1ZNwA=="}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:00:12.231200 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-7397caf7-85cb-4675-af81-b749822721ea tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Getting quotas for project 56047142d69c4c1cbfa9f6a278622332. Resources: {'key_pairs'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 05:00:12.234963 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-7397caf7-85cb-4675-af81-b749822721ea tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Getting quotas for user 32cbf88b156745ae9a59e8f795e8ef58 and project 56047142d69c4c1cbfa9f6a278622332. Resources: {'key_pairs'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 05:00:12.257843 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-7397caf7-85cb-4675-af81-b749822721ea tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.046927 Sep 20 05:00:12.258415 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 509/659] 10.222.0.27 () {62 vars in 1200 bytes} [Tue Sep 20 05:00:12 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 49 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 20 05:00:13.514210 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-dc26de21-328b-4e91-9426-065b525b468b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-502881932", "imageRef": "080ea053-830e-4470-a886-0ab99b0ab3e0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "df11c176-b7e2-4ad1-93ab-93f2f2c98460"}], "security_groups": [{"name": "tempest-securitygroup--1631131775"}], "key_name": "tempest-keypair-182015166", "user_data": "}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:00:13.615933 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.network.neutron [None req-dc26de21-328b-4e91-9426-065b525b468b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] validate_networks() for [('df11c176-b7e2-4ad1-93ab-93f2f2c98460', None, None, None, None, None)] {{(pid=126813) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 20 05:00:13.974596 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-dc26de21-328b-4e91-9426-065b525b468b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Flavor limits 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 20 05:00:13.975092 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-dc26de21-328b-4e91-9426-065b525b468b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Image limits 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 20 05:00:13.975644 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-dc26de21-328b-4e91-9426-065b525b468b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Flavor pref 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 20 05:00:13.976114 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-dc26de21-328b-4e91-9426-065b525b468b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Image pref 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 20 05:00:13.976839 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-dc26de21-328b-4e91-9426-065b525b468b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 20 05:00:13.987862 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-dc26de21-328b-4e91-9426-065b525b468b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:13.988351 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-dc26de21-328b-4e91-9426-065b525b468b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:13.988876 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-dc26de21-328b-4e91-9426-065b525b468b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:13.989585 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-dc26de21-328b-4e91-9426-065b525b468b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:13.990042 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-dc26de21-328b-4e91-9426-065b525b468b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:13.990473 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-dc26de21-328b-4e91-9426-065b525b468b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:14.006945 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-dc26de21-328b-4e91-9426-065b525b468b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Getting quotas for project 56047142d69c4c1cbfa9f6a278622332. Resources: {'ram', 'cores', 'instances'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 05:00:14.011498 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-dc26de21-328b-4e91-9426-065b525b468b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Getting quotas for user 32cbf88b156745ae9a59e8f795e8ef58 and project 56047142d69c4c1cbfa9f6a278622332. Resources: {'ram', 'cores', 'instances'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 05:00:14.022845 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-dc26de21-328b-4e91-9426-065b525b468b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Going to run 1 instances... {{(pid=126813) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 20 05:00:14.025730 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-dc26de21-328b-4e91-9426-065b525b468b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='080ea053-830e-4470-a886-0ab99b0ab3e0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126813) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 20 05:00:14.072192 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-dc26de21-328b-4e91-9426-065b525b468b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.563162 Sep 20 05:00:14.072877 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 510/660] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Sep 20 05:00:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 20 05:00:14.083772 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-58ec447a-4c66-4c80-b597-7fc9348823ec tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:00:14.084409 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-58ec447a-4c66-4c80-b597-7fc9348823ec tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:00:14.140167 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-58ec447a-4c66-4c80-b597-7fc9348823ec tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:00:14.147556 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-58ec447a-4c66-4c80-b597-7fc9348823ec tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:00:14.149084 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-58ec447a-4c66-4c80-b597-7fc9348823ec tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:00:14.150183 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-58ec447a-4c66-4c80-b597-7fc9348823ec tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 200 len: 1280 microversion: 2.20 time: 0.070208 Sep 20 05:00:14.150976 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 511/661] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:00:14 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 1280 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 05:00:15.174869 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-6fb855fb-a350-4c5d-9b8c-e8ec77cf7a62 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:00:15.175480 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-6fb855fb-a350-4c5d-9b8c-e8ec77cf7a62 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:00:15.181924 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6fb855fb-a350-4c5d-9b8c-e8ec77cf7a62 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:15.182405 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6fb855fb-a350-4c5d-9b8c-e8ec77cf7a62 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:15.182843 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6fb855fb-a350-4c5d-9b8c-e8ec77cf7a62 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:15.183524 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6fb855fb-a350-4c5d-9b8c-e8ec77cf7a62 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:15.183973 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6fb855fb-a350-4c5d-9b8c-e8ec77cf7a62 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:15.184395 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6fb855fb-a350-4c5d-9b8c-e8ec77cf7a62 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:15.243969 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-6fb855fb-a350-4c5d-9b8c-e8ec77cf7a62 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:00:15.252017 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-6fb855fb-a350-4c5d-9b8c-e8ec77cf7a62 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:00:15.253504 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-6fb855fb-a350-4c5d-9b8c-e8ec77cf7a62 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:00:15.254604 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-6fb855fb-a350-4c5d-9b8c-e8ec77cf7a62 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 200 len: 1332 microversion: 2.20 time: 0.083663 Sep 20 05:00:15.255155 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 512/662] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:00:15 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 1332 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 05:00:16.279807 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-388b48be-692b-48d8-9a2b-ec86a4409513 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:00:16.280523 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-388b48be-692b-48d8-9a2b-ec86a4409513 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:00:16.287706 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-388b48be-692b-48d8-9a2b-ec86a4409513 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:16.288243 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-388b48be-692b-48d8-9a2b-ec86a4409513 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:16.289677 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-388b48be-692b-48d8-9a2b-ec86a4409513 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:16.290779 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-388b48be-692b-48d8-9a2b-ec86a4409513 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:16.290916 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-388b48be-692b-48d8-9a2b-ec86a4409513 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:16.291299 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-388b48be-692b-48d8-9a2b-ec86a4409513 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:16.433688 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-388b48be-692b-48d8-9a2b-ec86a4409513 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:00:16.442264 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-388b48be-692b-48d8-9a2b-ec86a4409513 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:00:16.443656 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-388b48be-692b-48d8-9a2b-ec86a4409513 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:00:16.444809 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-388b48be-692b-48d8-9a2b-ec86a4409513 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 200 len: 1406 microversion: 2.20 time: 0.169033 Sep 20 05:00:16.445372 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 513/663] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:00:16 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 05:00:16.897010 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-50b5e9ae-22b0-413d-a9b8-e4acef0ddc58 req-77753157-308a-4a2a-a19a-9f791e8d7895 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0", "tag": "2c6ea4a8-2bc8-407d-bc89-481d40fa0d7f"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:00:16.907820 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-50b5e9ae-22b0-413d-a9b8-e4acef0ddc58 req-77753157-308a-4a2a-a19a-9f791e8d7895 service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:16.908294 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-50b5e9ae-22b0-413d-a9b8-e4acef0ddc58 req-77753157-308a-4a2a-a19a-9f791e8d7895 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:16.908870 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-50b5e9ae-22b0-413d-a9b8-e4acef0ddc58 req-77753157-308a-4a2a-a19a-9f791e8d7895 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:16.920354 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-50b5e9ae-22b0-413d-a9b8-e4acef0ddc58 req-77753157-308a-4a2a-a19a-9f791e8d7895 service nova] Creating event network-changed:2c6ea4a8-2bc8-407d-bc89-481d40fa0d7f for instance 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 on hv-cinder-75671 Sep 20 05:00:16.925442 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-50b5e9ae-22b0-413d-a9b8-e4acef0ddc58 req-77753157-308a-4a2a-a19a-9f791e8d7895 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032430 Sep 20 05:00:16.926029 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 514/664] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 05:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 05:00:17.471247 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-7df752c9-dc8c-42e4-989c-99ccec0059d9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:00:17.471873 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-7df752c9-dc8c-42e4-989c-99ccec0059d9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:00:17.478615 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7df752c9-dc8c-42e4-989c-99ccec0059d9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:17.479095 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7df752c9-dc8c-42e4-989c-99ccec0059d9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:17.479535 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7df752c9-dc8c-42e4-989c-99ccec0059d9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:17.480219 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7df752c9-dc8c-42e4-989c-99ccec0059d9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:17.480692 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7df752c9-dc8c-42e4-989c-99ccec0059d9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:17.481119 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7df752c9-dc8c-42e4-989c-99ccec0059d9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:17.605141 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-7df752c9-dc8c-42e4-989c-99ccec0059d9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:00:17.613403 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-7df752c9-dc8c-42e4-989c-99ccec0059d9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:00:17.614850 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-7df752c9-dc8c-42e4-989c-99ccec0059d9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:00:17.615957 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-7df752c9-dc8c-42e4-989c-99ccec0059d9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 200 len: 1406 microversion: 2.20 time: 0.149608 Sep 20 05:00:17.617129 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 515/665] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:00:17 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 05:00:18.641413 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-e2f4de18-85f4-4d9d-95c6-64ef4cbba954 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:00:18.642136 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-e2f4de18-85f4-4d9d-95c6-64ef4cbba954 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:00:18.648506 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e2f4de18-85f4-4d9d-95c6-64ef4cbba954 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:18.649028 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e2f4de18-85f4-4d9d-95c6-64ef4cbba954 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:18.649466 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e2f4de18-85f4-4d9d-95c6-64ef4cbba954 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:18.650157 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e2f4de18-85f4-4d9d-95c6-64ef4cbba954 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:18.650609 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e2f4de18-85f4-4d9d-95c6-64ef4cbba954 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:18.651033 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e2f4de18-85f4-4d9d-95c6-64ef4cbba954 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:18.781075 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-e2f4de18-85f4-4d9d-95c6-64ef4cbba954 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:00:18.789161 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-e2f4de18-85f4-4d9d-95c6-64ef4cbba954 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:00:18.790623 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-e2f4de18-85f4-4d9d-95c6-64ef4cbba954 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:00:18.791737 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-e2f4de18-85f4-4d9d-95c6-64ef4cbba954 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 200 len: 1406 microversion: 2.20 time: 0.154569 Sep 20 05:00:18.792299 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 516/666] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:00:18 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 05:00:19.816707 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-4d11422a-4cb1-4c66-a406-3dd3f9dbc790 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:00:19.817412 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-4d11422a-4cb1-4c66-a406-3dd3f9dbc790 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:00:19.824317 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4d11422a-4cb1-4c66-a406-3dd3f9dbc790 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:19.824847 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4d11422a-4cb1-4c66-a406-3dd3f9dbc790 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:19.825287 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4d11422a-4cb1-4c66-a406-3dd3f9dbc790 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:19.825976 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4d11422a-4cb1-4c66-a406-3dd3f9dbc790 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:19.826430 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4d11422a-4cb1-4c66-a406-3dd3f9dbc790 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:19.826857 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4d11422a-4cb1-4c66-a406-3dd3f9dbc790 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:19.952931 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-4d11422a-4cb1-4c66-a406-3dd3f9dbc790 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:00:19.958424 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:00:19.963175 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-4d11422a-4cb1-4c66-a406-3dd3f9dbc790 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:00:19.964747 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-4d11422a-4cb1-4c66-a406-3dd3f9dbc790 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:00:19.965876 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-4d11422a-4cb1-4c66-a406-3dd3f9dbc790 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 200 len: 1406 microversion: 2.20 time: 0.153124 Sep 20 05:00:19.966444 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 517/667] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:00:19 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 05:00:20.984448 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-6d08e943-1dd1-40a7-9e24-96ad7c1d2f2f req-42a8c4ac-82f3-421e-9118-33353f4fd8c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0", "name": "network-vif-plugged", "status": "completed", "tag": "2c6ea4a8-2bc8-407d-bc89-481d40fa0d7f"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:00:20.996085 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-6d08e943-1dd1-40a7-9e24-96ad7c1d2f2f req-42a8c4ac-82f3-421e-9118-33353f4fd8c1 service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:20.996566 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-6d08e943-1dd1-40a7-9e24-96ad7c1d2f2f req-42a8c4ac-82f3-421e-9118-33353f4fd8c1 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:20.997022 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-6d08e943-1dd1-40a7-9e24-96ad7c1d2f2f req-42a8c4ac-82f3-421e-9118-33353f4fd8c1 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:21.008257 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-6d08e943-1dd1-40a7-9e24-96ad7c1d2f2f req-42a8c4ac-82f3-421e-9118-33353f4fd8c1 service nova] Creating event network-vif-plugged:2c6ea4a8-2bc8-407d-bc89-481d40fa0d7f for instance 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 on hv-cinder-75671 Sep 20 05:00:21.013289 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-6d08e943-1dd1-40a7-9e24-96ad7c1d2f2f req-42a8c4ac-82f3-421e-9118-33353f4fd8c1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033142 Sep 20 05:00:21.013890 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 518/668] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 05:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 05:00:21.018742 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-bc7f99db-95c5-4e7f-8703-734a4f102d46 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:00:21.019425 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-bc7f99db-95c5-4e7f-8703-734a4f102d46 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:00:21.025965 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-bc7f99db-95c5-4e7f-8703-734a4f102d46 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:21.026443 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-bc7f99db-95c5-4e7f-8703-734a4f102d46 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:21.026873 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-bc7f99db-95c5-4e7f-8703-734a4f102d46 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:21.027556 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-bc7f99db-95c5-4e7f-8703-734a4f102d46 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:21.027999 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-bc7f99db-95c5-4e7f-8703-734a4f102d46 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:21.028417 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-bc7f99db-95c5-4e7f-8703-734a4f102d46 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:21.170679 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-bc7f99db-95c5-4e7f-8703-734a4f102d46 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:00:21.179560 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-bc7f99db-95c5-4e7f-8703-734a4f102d46 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:00:21.181051 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-bc7f99db-95c5-4e7f-8703-734a4f102d46 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:00:21.182169 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-bc7f99db-95c5-4e7f-8703-734a4f102d46 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 200 len: 1406 microversion: 2.20 time: 0.167236 Sep 20 05:00:21.182724 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 519/669] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:00:21 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 05:00:22.207385 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-b577b7f7-8d53-405f-b7da-82659294498a tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:00:22.207988 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-b577b7f7-8d53-405f-b7da-82659294498a tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:00:22.215005 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b577b7f7-8d53-405f-b7da-82659294498a tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:22.215484 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b577b7f7-8d53-405f-b7da-82659294498a tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:22.215922 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b577b7f7-8d53-405f-b7da-82659294498a tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:22.216630 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b577b7f7-8d53-405f-b7da-82659294498a tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:22.217075 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b577b7f7-8d53-405f-b7da-82659294498a tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:22.217494 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b577b7f7-8d53-405f-b7da-82659294498a tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:22.344984 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-b577b7f7-8d53-405f-b7da-82659294498a tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:00:22.352953 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-b577b7f7-8d53-405f-b7da-82659294498a tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:00:22.354391 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-b577b7f7-8d53-405f-b7da-82659294498a tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:00:22.355481 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-b577b7f7-8d53-405f-b7da-82659294498a tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 200 len: 1406 microversion: 2.20 time: 0.152109 Sep 20 05:00:22.356073 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 520/670] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:00:22 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 05:00:23.379492 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-c3cedfdc-fbf3-4d49-a5ef-a3d6f00b751d tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:00:23.380153 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-c3cedfdc-fbf3-4d49-a5ef-a3d6f00b751d tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:00:23.387132 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c3cedfdc-fbf3-4d49-a5ef-a3d6f00b751d tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:23.387608 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c3cedfdc-fbf3-4d49-a5ef-a3d6f00b751d tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:23.388301 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c3cedfdc-fbf3-4d49-a5ef-a3d6f00b751d tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:23.389003 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c3cedfdc-fbf3-4d49-a5ef-a3d6f00b751d tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:23.389450 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c3cedfdc-fbf3-4d49-a5ef-a3d6f00b751d tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:23.389867 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c3cedfdc-fbf3-4d49-a5ef-a3d6f00b751d tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:23.515779 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-c3cedfdc-fbf3-4d49-a5ef-a3d6f00b751d tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:00:23.523786 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-c3cedfdc-fbf3-4d49-a5ef-a3d6f00b751d tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:00:23.525274 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-c3cedfdc-fbf3-4d49-a5ef-a3d6f00b751d tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:00:23.526422 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-c3cedfdc-fbf3-4d49-a5ef-a3d6f00b751d tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 200 len: 1597 microversion: 2.20 time: 0.150841 Sep 20 05:00:23.526971 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 521/671] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:00:23 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 1597 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 05:00:23.550248 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-d69a21c8-afd1-4d40-81e2-0c385b254fd5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:00:23.550727 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-d69a21c8-afd1-4d40-81e2-0c385b254fd5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:00:23.556845 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d69a21c8-afd1-4d40-81e2-0c385b254fd5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:23.557321 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d69a21c8-afd1-4d40-81e2-0c385b254fd5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:23.557777 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d69a21c8-afd1-4d40-81e2-0c385b254fd5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:23.558446 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d69a21c8-afd1-4d40-81e2-0c385b254fd5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:23.558913 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d69a21c8-afd1-4d40-81e2-0c385b254fd5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:23.559329 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d69a21c8-afd1-4d40-81e2-0c385b254fd5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:23.636128 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-d69a21c8-afd1-4d40-81e2-0c385b254fd5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.089295 Sep 20 05:00:23.636725 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 522/672] 10.222.0.27 () {60 vars in 1316 bytes} [Tue Sep 20 05:00:23 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 20 05:00:24.782500 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell0:SELECT=2 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:00:24.783358 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell0:SELECT=12 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:00:24.787639 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-5b382261-cdfc-42f5-bdcd-3d00fbb5ae30 req-f5c5bb95-81cd-4b87-9e99-78a608c45a68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0", "tag": "2c6ea4a8-2bc8-407d-bc89-481d40fa0d7f"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:00:24.798543 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-5b382261-cdfc-42f5-bdcd-3d00fbb5ae30 req-f5c5bb95-81cd-4b87-9e99-78a608c45a68 service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:24.799090 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-5b382261-cdfc-42f5-bdcd-3d00fbb5ae30 req-f5c5bb95-81cd-4b87-9e99-78a608c45a68 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:24.799583 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-5b382261-cdfc-42f5-bdcd-3d00fbb5ae30 req-f5c5bb95-81cd-4b87-9e99-78a608c45a68 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:24.810665 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-5b382261-cdfc-42f5-bdcd-3d00fbb5ae30 req-f5c5bb95-81cd-4b87-9e99-78a608c45a68 service nova] Creating event network-changed:2c6ea4a8-2bc8-407d-bc89-481d40fa0d7f for instance 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 on hv-cinder-75671 Sep 20 05:00:24.815569 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-5b382261-cdfc-42f5-bdcd-3d00fbb5ae30 req-f5c5bb95-81cd-4b87-9e99-78a608c45a68 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033717 Sep 20 05:00:24.816201 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 523/673] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 05:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 05:00:39.235792 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 20 05:00:39.236369 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: Tue Sep 20 05:00:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.27) !!! Sep 20 05:00:47.055222 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:00:47.056134 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell1:SELECT=26 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:00:47.060644 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-1889c83a-3355-4e9d-82d6-762aa34b99da tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1351082044", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-140645421", "security_groups": [{"name": "tempest-secgroup-smoke-293602655"}], "block_device_mapping_v2": [{"uuid": "60c42916-fdfc-4fa2-86a3-948c189336e3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6de81d04-87bb-4e82-ba15-9636966f9274"}]}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:00:47.179040 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.network.neutron [None req-1889c83a-3355-4e9d-82d6-762aa34b99da tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] validate_networks() for [('6de81d04-87bb-4e82-ba15-9636966f9274', None, None, None, None, None)] {{(pid=126813) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 20 05:00:47.541473 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-1889c83a-3355-4e9d-82d6-762aa34b99da tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Flavor limits 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 20 05:00:47.541900 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-1889c83a-3355-4e9d-82d6-762aa34b99da tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Image limits 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 20 05:00:47.542374 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-1889c83a-3355-4e9d-82d6-762aa34b99da tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Flavor pref 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 20 05:00:47.542783 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-1889c83a-3355-4e9d-82d6-762aa34b99da tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Image pref 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 20 05:00:47.543193 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-1889c83a-3355-4e9d-82d6-762aa34b99da tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 20 05:00:47.551941 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1889c83a-3355-4e9d-82d6-762aa34b99da tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:47.552424 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1889c83a-3355-4e9d-82d6-762aa34b99da tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:47.552890 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1889c83a-3355-4e9d-82d6-762aa34b99da tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:47.553618 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1889c83a-3355-4e9d-82d6-762aa34b99da tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:47.554074 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1889c83a-3355-4e9d-82d6-762aa34b99da tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:47.554504 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1889c83a-3355-4e9d-82d6-762aa34b99da tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:47.571458 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-1889c83a-3355-4e9d-82d6-762aa34b99da tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Getting quotas for project 46ddf925b345471da94d05998a6a0540. Resources: {'ram', 'cores', 'instances'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 05:00:47.575399 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-1889c83a-3355-4e9d-82d6-762aa34b99da tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Getting quotas for user 946a0fd33f754ce1aa534ab88dc95aa9 and project 46ddf925b345471da94d05998a6a0540. Resources: {'ram', 'cores', 'instances'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 05:00:47.630951 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-1889c83a-3355-4e9d-82d6-762aa34b99da tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Going to run 1 instances... {{(pid=126813) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 20 05:00:47.633216 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-1889c83a-3355-4e9d-82d6-762aa34b99da tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: 7d0a9581-09a0-4287-ac5a-260cbfd04a98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='60c42916-fdfc-4fa2-86a3-948c189336e3',volume_size=None,volume_type=None)] {{(pid=126813) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 20 05:00:47.763732 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-1889c83a-3355-4e9d-82d6-762aa34b99da tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.710169 Sep 20 05:00:47.764378 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 524/674] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Sep 20 05:00:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 20 05:00:47.776056 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-b74e8484-06f0-4c95-8cba-32dd6a57bd86 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:00:47.776708 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-b74e8484-06f0-4c95-8cba-32dd6a57bd86 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: 7d0a9581-09a0-4287-ac5a-260cbfd04a98] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:00:47.828352 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-b74e8484-06f0-4c95-8cba-32dd6a57bd86 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:00:47.836831 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-b74e8484-06f0-4c95-8cba-32dd6a57bd86 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/7d0a9581-09a0-4287-ac5a-260cbfd04a98" status: 200 len: 1094 microversion: 2.1 time: 0.064525 Sep 20 05:00:47.837401 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 525/675] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:00:47 2022] GET /compute/v2.1/servers/7d0a9581-09a0-4287-ac5a-260cbfd04a98 => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:00:48.861226 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-a731b8ac-3486-448a-a96c-73e8f9dc3607 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:00:48.861878 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-a731b8ac-3486-448a-a96c-73e8f9dc3607 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: 7d0a9581-09a0-4287-ac5a-260cbfd04a98] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:00:48.868950 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a731b8ac-3486-448a-a96c-73e8f9dc3607 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:48.869443 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a731b8ac-3486-448a-a96c-73e8f9dc3607 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:48.869893 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a731b8ac-3486-448a-a96c-73e8f9dc3607 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:48.870695 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a731b8ac-3486-448a-a96c-73e8f9dc3607 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:48.871277 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a731b8ac-3486-448a-a96c-73e8f9dc3607 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:48.871802 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a731b8ac-3486-448a-a96c-73e8f9dc3607 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:48.954405 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-a731b8ac-3486-448a-a96c-73e8f9dc3607 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:00:48.963093 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-a731b8ac-3486-448a-a96c-73e8f9dc3607 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/7d0a9581-09a0-4287-ac5a-260cbfd04a98" status: 200 len: 1200 microversion: 2.1 time: 0.105767 Sep 20 05:00:48.963650 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 526/676] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:00:48 2022] GET /compute/v2.1/servers/7d0a9581-09a0-4287-ac5a-260cbfd04a98 => generated 1200 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:00:49.987040 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-3df6d310-f680-4ede-9068-a95a33535c28 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:00:49.987905 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-3df6d310-f680-4ede-9068-a95a33535c28 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: 7d0a9581-09a0-4287-ac5a-260cbfd04a98] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:00:49.995444 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3df6d310-f680-4ede-9068-a95a33535c28 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:49.996006 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3df6d310-f680-4ede-9068-a95a33535c28 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:49.996510 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3df6d310-f680-4ede-9068-a95a33535c28 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:49.997302 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3df6d310-f680-4ede-9068-a95a33535c28 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:49.997864 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3df6d310-f680-4ede-9068-a95a33535c28 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:49.998363 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3df6d310-f680-4ede-9068-a95a33535c28 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:50.150682 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-3df6d310-f680-4ede-9068-a95a33535c28 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:00:50.159431 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-3df6d310-f680-4ede-9068-a95a33535c28 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/7d0a9581-09a0-4287-ac5a-260cbfd04a98" status: 200 len: 1265 microversion: 2.1 time: 0.176395 Sep 20 05:00:50.160023 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 527/677] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:00:49 2022] GET /compute/v2.1/servers/7d0a9581-09a0-4287-ac5a-260cbfd04a98 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:00:50.285352 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-9187c315-c730-4064-8942-82e08db3b5b9 req-9d79b270-4eb3-4b7c-9e68-33a46fa9556d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d0a9581-09a0-4287-ac5a-260cbfd04a98", "tag": "8a48051c-d8ba-4a69-917d-d7daa79bcd01"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:00:50.297384 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-9187c315-c730-4064-8942-82e08db3b5b9 req-9d79b270-4eb3-4b7c-9e68-33a46fa9556d service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:50.297862 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-9187c315-c730-4064-8942-82e08db3b5b9 req-9d79b270-4eb3-4b7c-9e68-33a46fa9556d service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:50.298288 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-9187c315-c730-4064-8942-82e08db3b5b9 req-9d79b270-4eb3-4b7c-9e68-33a46fa9556d service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:50.309621 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-9187c315-c730-4064-8942-82e08db3b5b9 req-9d79b270-4eb3-4b7c-9e68-33a46fa9556d service nova] Creating event network-changed:8a48051c-d8ba-4a69-917d-d7daa79bcd01 for instance 7d0a9581-09a0-4287-ac5a-260cbfd04a98 on hv-cinder-75671 Sep 20 05:00:50.314842 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-9187c315-c730-4064-8942-82e08db3b5b9 req-9d79b270-4eb3-4b7c-9e68-33a46fa9556d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034097 Sep 20 05:00:50.315434 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 528/678] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 05:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 05:00:51.184074 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-b3c5898d-1785-4b44-9b6c-16535d936ee4 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:00:51.184794 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-b3c5898d-1785-4b44-9b6c-16535d936ee4 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: 7d0a9581-09a0-4287-ac5a-260cbfd04a98] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:00:51.191283 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b3c5898d-1785-4b44-9b6c-16535d936ee4 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:51.191759 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b3c5898d-1785-4b44-9b6c-16535d936ee4 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:51.192188 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b3c5898d-1785-4b44-9b6c-16535d936ee4 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:51.193472 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b3c5898d-1785-4b44-9b6c-16535d936ee4 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:51.193922 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b3c5898d-1785-4b44-9b6c-16535d936ee4 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:51.194341 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b3c5898d-1785-4b44-9b6c-16535d936ee4 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:51.323503 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-b3c5898d-1785-4b44-9b6c-16535d936ee4 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:00:51.331201 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-b3c5898d-1785-4b44-9b6c-16535d936ee4 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/7d0a9581-09a0-4287-ac5a-260cbfd04a98" status: 200 len: 1265 microversion: 2.1 time: 0.151709 Sep 20 05:00:51.331764 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 529/679] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:00:51 2022] GET /compute/v2.1/servers/7d0a9581-09a0-4287-ac5a-260cbfd04a98 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:00:52.357325 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-776671d6-c95b-4ecb-a8e8-5f60fe27f130 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:00:52.358022 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-776671d6-c95b-4ecb-a8e8-5f60fe27f130 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: 7d0a9581-09a0-4287-ac5a-260cbfd04a98] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:00:52.364967 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-776671d6-c95b-4ecb-a8e8-5f60fe27f130 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:52.365464 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-776671d6-c95b-4ecb-a8e8-5f60fe27f130 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:52.365874 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-776671d6-c95b-4ecb-a8e8-5f60fe27f130 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:52.366549 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-776671d6-c95b-4ecb-a8e8-5f60fe27f130 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:52.366995 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-776671d6-c95b-4ecb-a8e8-5f60fe27f130 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:52.367413 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-776671d6-c95b-4ecb-a8e8-5f60fe27f130 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:52.493113 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-776671d6-c95b-4ecb-a8e8-5f60fe27f130 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:00:52.500687 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-776671d6-c95b-4ecb-a8e8-5f60fe27f130 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/7d0a9581-09a0-4287-ac5a-260cbfd04a98" status: 200 len: 1265 microversion: 2.1 time: 0.147203 Sep 20 05:00:52.501246 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 530/680] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:00:52 2022] GET /compute/v2.1/servers/7d0a9581-09a0-4287-ac5a-260cbfd04a98 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:00:53.524370 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-fdd221b5-6611-42a7-9d28-4358c25fbcd1 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:00:53.525036 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-fdd221b5-6611-42a7-9d28-4358c25fbcd1 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: 7d0a9581-09a0-4287-ac5a-260cbfd04a98] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:00:53.531327 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fdd221b5-6611-42a7-9d28-4358c25fbcd1 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:53.531809 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fdd221b5-6611-42a7-9d28-4358c25fbcd1 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:53.532238 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fdd221b5-6611-42a7-9d28-4358c25fbcd1 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:53.532946 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fdd221b5-6611-42a7-9d28-4358c25fbcd1 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:53.533397 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fdd221b5-6611-42a7-9d28-4358c25fbcd1 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:53.533816 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fdd221b5-6611-42a7-9d28-4358c25fbcd1 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:53.662637 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-fdd221b5-6611-42a7-9d28-4358c25fbcd1 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:00:53.670207 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-fdd221b5-6611-42a7-9d28-4358c25fbcd1 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/7d0a9581-09a0-4287-ac5a-260cbfd04a98" status: 200 len: 1265 microversion: 2.1 time: 0.150253 Sep 20 05:00:53.670766 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 531/681] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:00:53 2022] GET /compute/v2.1/servers/7d0a9581-09a0-4287-ac5a-260cbfd04a98 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:00:54.692525 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-74eeaf16-4fb8-4e16-abce-5151f85cffa3 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:00:54.693200 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-74eeaf16-4fb8-4e16-abce-5151f85cffa3 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: 7d0a9581-09a0-4287-ac5a-260cbfd04a98] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:00:54.699615 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-74eeaf16-4fb8-4e16-abce-5151f85cffa3 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:54.700096 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-74eeaf16-4fb8-4e16-abce-5151f85cffa3 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:54.700525 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-74eeaf16-4fb8-4e16-abce-5151f85cffa3 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:54.701224 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-74eeaf16-4fb8-4e16-abce-5151f85cffa3 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:54.701669 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-74eeaf16-4fb8-4e16-abce-5151f85cffa3 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:54.702087 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-74eeaf16-4fb8-4e16-abce-5151f85cffa3 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:54.830713 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-74eeaf16-4fb8-4e16-abce-5151f85cffa3 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:00:54.839035 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-74eeaf16-4fb8-4e16-abce-5151f85cffa3 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/7d0a9581-09a0-4287-ac5a-260cbfd04a98" status: 200 len: 1265 microversion: 2.1 time: 0.150321 Sep 20 05:00:54.839607 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 532/682] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:00:54 2022] GET /compute/v2.1/servers/7d0a9581-09a0-4287-ac5a-260cbfd04a98 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:00:55.862897 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-3eb17b9d-56c2-4e9e-89a5-bad771edc508 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:00:55.863568 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-3eb17b9d-56c2-4e9e-89a5-bad771edc508 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: 7d0a9581-09a0-4287-ac5a-260cbfd04a98] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:00:55.870588 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3eb17b9d-56c2-4e9e-89a5-bad771edc508 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:55.871079 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3eb17b9d-56c2-4e9e-89a5-bad771edc508 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:55.871516 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3eb17b9d-56c2-4e9e-89a5-bad771edc508 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:55.872203 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3eb17b9d-56c2-4e9e-89a5-bad771edc508 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:55.872757 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3eb17b9d-56c2-4e9e-89a5-bad771edc508 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:55.873190 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3eb17b9d-56c2-4e9e-89a5-bad771edc508 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:56.003454 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-3eb17b9d-56c2-4e9e-89a5-bad771edc508 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:00:56.011153 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-3eb17b9d-56c2-4e9e-89a5-bad771edc508 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/7d0a9581-09a0-4287-ac5a-260cbfd04a98" status: 200 len: 1265 microversion: 2.1 time: 0.152161 Sep 20 05:00:56.011749 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 533/683] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:00:55 2022] GET /compute/v2.1/servers/7d0a9581-09a0-4287-ac5a-260cbfd04a98 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:00:57.033916 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-c8480a3e-fc43-49da-acb8-4808313e0730 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:00:57.034555 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-c8480a3e-fc43-49da-acb8-4808313e0730 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: 7d0a9581-09a0-4287-ac5a-260cbfd04a98] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:00:57.040403 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c8480a3e-fc43-49da-acb8-4808313e0730 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:57.045138 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c8480a3e-fc43-49da-acb8-4808313e0730 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:57.045138 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c8480a3e-fc43-49da-acb8-4808313e0730 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:57.045138 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c8480a3e-fc43-49da-acb8-4808313e0730 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:57.045138 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c8480a3e-fc43-49da-acb8-4808313e0730 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:57.047647 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c8480a3e-fc43-49da-acb8-4808313e0730 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:57.175342 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-c8480a3e-fc43-49da-acb8-4808313e0730 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:00:57.183606 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-c8480a3e-fc43-49da-acb8-4808313e0730 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/7d0a9581-09a0-4287-ac5a-260cbfd04a98" status: 200 len: 1265 microversion: 2.1 time: 0.153722 Sep 20 05:00:57.184176 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 534/684] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:00:57 2022] GET /compute/v2.1/servers/7d0a9581-09a0-4287-ac5a-260cbfd04a98 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:00:58.207219 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-2de2995d-7b58-4b5b-9999-12bbbe3d8d8c tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:00:58.208405 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-2de2995d-7b58-4b5b-9999-12bbbe3d8d8c tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: 7d0a9581-09a0-4287-ac5a-260cbfd04a98] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:00:58.210336 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell0:SELECT=2 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:00:58.211018 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell0:SELECT=8 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:00:58.217303 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2de2995d-7b58-4b5b-9999-12bbbe3d8d8c tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:58.217785 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2de2995d-7b58-4b5b-9999-12bbbe3d8d8c tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:58.218220 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2de2995d-7b58-4b5b-9999-12bbbe3d8d8c tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:58.218905 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2de2995d-7b58-4b5b-9999-12bbbe3d8d8c tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:58.219356 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2de2995d-7b58-4b5b-9999-12bbbe3d8d8c tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:58.219781 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2de2995d-7b58-4b5b-9999-12bbbe3d8d8c tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:58.348533 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-2de2995d-7b58-4b5b-9999-12bbbe3d8d8c tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:00:58.356443 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-2de2995d-7b58-4b5b-9999-12bbbe3d8d8c tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/7d0a9581-09a0-4287-ac5a-260cbfd04a98" status: 200 len: 1265 microversion: 2.1 time: 0.153079 Sep 20 05:00:58.357042 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 535/685] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:00:58 2022] GET /compute/v2.1/servers/7d0a9581-09a0-4287-ac5a-260cbfd04a98 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:00:59.187891 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-8cd9ef80-bf11-4a36-ae18-117471bc8e4e req-df57e9b1-9658-40f0-948f-0e269af9b129 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d0a9581-09a0-4287-ac5a-260cbfd04a98", "name": "network-vif-plugged", "status": "completed", "tag": "8a48051c-d8ba-4a69-917d-d7daa79bcd01"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:00:59.197465 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-8cd9ef80-bf11-4a36-ae18-117471bc8e4e req-df57e9b1-9658-40f0-948f-0e269af9b129 service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:59.197933 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-8cd9ef80-bf11-4a36-ae18-117471bc8e4e req-df57e9b1-9658-40f0-948f-0e269af9b129 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:59.198361 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-8cd9ef80-bf11-4a36-ae18-117471bc8e4e req-df57e9b1-9658-40f0-948f-0e269af9b129 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:59.210156 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-8cd9ef80-bf11-4a36-ae18-117471bc8e4e req-df57e9b1-9658-40f0-948f-0e269af9b129 service nova] Creating event network-vif-plugged:8a48051c-d8ba-4a69-917d-d7daa79bcd01 for instance 7d0a9581-09a0-4287-ac5a-260cbfd04a98 on hv-cinder-75671 Sep 20 05:00:59.215076 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-8cd9ef80-bf11-4a36-ae18-117471bc8e4e req-df57e9b1-9658-40f0-948f-0e269af9b129 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030909 Sep 20 05:00:59.215709 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 536/686] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 05:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 05:00:59.379908 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-d770c4b8-29c0-4d3e-a18c-76d90a448741 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:00:59.380532 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-d770c4b8-29c0-4d3e-a18c-76d90a448741 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: 7d0a9581-09a0-4287-ac5a-260cbfd04a98] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:00:59.387482 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d770c4b8-29c0-4d3e-a18c-76d90a448741 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:59.387994 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d770c4b8-29c0-4d3e-a18c-76d90a448741 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:59.388964 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d770c4b8-29c0-4d3e-a18c-76d90a448741 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:59.389688 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d770c4b8-29c0-4d3e-a18c-76d90a448741 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:00:59.390137 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d770c4b8-29c0-4d3e-a18c-76d90a448741 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:00:59.390569 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d770c4b8-29c0-4d3e-a18c-76d90a448741 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:00:59.528139 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-d770c4b8-29c0-4d3e-a18c-76d90a448741 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:00:59.536082 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-d770c4b8-29c0-4d3e-a18c-76d90a448741 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/7d0a9581-09a0-4287-ac5a-260cbfd04a98" status: 200 len: 1265 microversion: 2.1 time: 0.160373 Sep 20 05:00:59.536578 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 537/687] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:00:59 2022] GET /compute/v2.1/servers/7d0a9581-09a0-4287-ac5a-260cbfd04a98 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:00:59.673745 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 20 05:00:59.674183 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: Tue Sep 20 05:00:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.27) !!! Sep 20 05:01:00.558747 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-a3adfba6-e941-4db2-89cd-356654ca363b tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:01:00.559360 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-a3adfba6-e941-4db2-89cd-356654ca363b tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: 7d0a9581-09a0-4287-ac5a-260cbfd04a98] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:01:00.565809 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a3adfba6-e941-4db2-89cd-356654ca363b tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:00.566291 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a3adfba6-e941-4db2-89cd-356654ca363b tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:00.566730 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a3adfba6-e941-4db2-89cd-356654ca363b tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:00.567413 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a3adfba6-e941-4db2-89cd-356654ca363b tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:00.567866 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a3adfba6-e941-4db2-89cd-356654ca363b tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:00.568290 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a3adfba6-e941-4db2-89cd-356654ca363b tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:00.696396 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-a3adfba6-e941-4db2-89cd-356654ca363b tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:00.704066 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-a3adfba6-e941-4db2-89cd-356654ca363b tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/7d0a9581-09a0-4287-ac5a-260cbfd04a98" status: 200 len: 1265 microversion: 2.1 time: 0.149231 Sep 20 05:01:00.704646 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 538/688] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:01:00 2022] GET /compute/v2.1/servers/7d0a9581-09a0-4287-ac5a-260cbfd04a98 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:01:00.714525 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-ed71bcfe-0947-4825-b710-22a463d334a1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:01:00.715012 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-ed71bcfe-0947-4825-b710-22a463d334a1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:01:00.720617 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ed71bcfe-0947-4825-b710-22a463d334a1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:00.721101 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ed71bcfe-0947-4825-b710-22a463d334a1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:00.721529 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ed71bcfe-0947-4825-b710-22a463d334a1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:00.722203 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ed71bcfe-0947-4825-b710-22a463d334a1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:00.722648 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ed71bcfe-0947-4825-b710-22a463d334a1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:00.723065 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ed71bcfe-0947-4825-b710-22a463d334a1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:00.745900 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-ed71bcfe-0947-4825-b710-22a463d334a1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0/ips" status: 200 len: 151 microversion: 2.20 time: 0.034998 Sep 20 05:01:00.746449 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 539/689] 10.222.0.27 () {60 vars in 1289 bytes} [Tue Sep 20 05:01:00 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0/ips => generated 151 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 20 05:01:01.865759 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-d7a0b540-4f4e-4041-af80-6a4d1a5a2d0d tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:01:01.866372 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-d7a0b540-4f4e-4041-af80-6a4d1a5a2d0d tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: 7d0a9581-09a0-4287-ac5a-260cbfd04a98] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:01:01.872343 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d7a0b540-4f4e-4041-af80-6a4d1a5a2d0d tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:01.872870 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d7a0b540-4f4e-4041-af80-6a4d1a5a2d0d tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:01.873313 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d7a0b540-4f4e-4041-af80-6a4d1a5a2d0d tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:01.874008 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d7a0b540-4f4e-4041-af80-6a4d1a5a2d0d tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:01.874462 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d7a0b540-4f4e-4041-af80-6a4d1a5a2d0d tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:01.874910 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d7a0b540-4f4e-4041-af80-6a4d1a5a2d0d tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:02.007150 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-d7a0b540-4f4e-4041-af80-6a4d1a5a2d0d tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:02.015125 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-d7a0b540-4f4e-4041-af80-6a4d1a5a2d0d tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/7d0a9581-09a0-4287-ac5a-260cbfd04a98" status: 200 len: 1452 microversion: 2.1 time: 0.291499 Sep 20 05:01:02.015690 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 540/690] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:01:01 2022] GET /compute/v2.1/servers/7d0a9581-09a0-4287-ac5a-260cbfd04a98 => generated 1452 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:01:02.037023 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-1a5b11c8-3f5c-4d60-a95e-abaccd2e1436 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:01:02.037637 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-1a5b11c8-3f5c-4d60-a95e-abaccd2e1436 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: 7d0a9581-09a0-4287-ac5a-260cbfd04a98] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:01:02.043429 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1a5b11c8-3f5c-4d60-a95e-abaccd2e1436 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:02.043915 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1a5b11c8-3f5c-4d60-a95e-abaccd2e1436 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:02.044355 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1a5b11c8-3f5c-4d60-a95e-abaccd2e1436 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:02.045070 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1a5b11c8-3f5c-4d60-a95e-abaccd2e1436 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:02.045527 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1a5b11c8-3f5c-4d60-a95e-abaccd2e1436 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:02.045955 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1a5b11c8-3f5c-4d60-a95e-abaccd2e1436 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:02.174131 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-1a5b11c8-3f5c-4d60-a95e-abaccd2e1436 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:02.182626 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-1a5b11c8-3f5c-4d60-a95e-abaccd2e1436 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/7d0a9581-09a0-4287-ac5a-260cbfd04a98" status: 200 len: 1452 microversion: 2.1 time: 0.149267 Sep 20 05:01:02.183188 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 541/691] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:01:02 2022] GET /compute/v2.1/servers/7d0a9581-09a0-4287-ac5a-260cbfd04a98 => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:01:02.850609 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-1b4e8c28-6a97-430c-bf0a-1f5a52cc6877 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:01:02.851915 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-1b4e8c28-6a97-430c-bf0a-1f5a52cc6877 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:01:02.859044 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1b4e8c28-6a97-430c-bf0a-1f5a52cc6877 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:02.859593 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1b4e8c28-6a97-430c-bf0a-1f5a52cc6877 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:02.860058 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1b4e8c28-6a97-430c-bf0a-1f5a52cc6877 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:02.860800 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1b4e8c28-6a97-430c-bf0a-1f5a52cc6877 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:02.861254 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1b4e8c28-6a97-430c-bf0a-1f5a52cc6877 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:02.861716 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1b4e8c28-6a97-430c-bf0a-1f5a52cc6877 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:02.887405 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.objects.instance [None req-1b4e8c28-6a97-430c-bf0a-1f5a52cc6877 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lazy-loading 'flavor' on Instance uuid 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 {{(pid=126813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 05:01:02.929650 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:01:03.086855 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-1b4e8c28-6a97-430c-bf0a-1f5a52cc6877 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "POST /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0/action" status: 202 len: 0 microversion: 2.20 time: 0.241584 Sep 20 05:01:03.090726 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 542/692] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Sep 20 05:01:02 2022] POST /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 20 05:01:03.096484 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-1dbbf0bd-5725-4c93-8a18-81086e0b3b73 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:01:03.097226 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-1dbbf0bd-5725-4c93-8a18-81086e0b3b73 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:01:03.104485 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1dbbf0bd-5725-4c93-8a18-81086e0b3b73 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:03.105177 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1dbbf0bd-5725-4c93-8a18-81086e0b3b73 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:03.105630 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1dbbf0bd-5725-4c93-8a18-81086e0b3b73 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:03.106419 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1dbbf0bd-5725-4c93-8a18-81086e0b3b73 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:03.106879 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1dbbf0bd-5725-4c93-8a18-81086e0b3b73 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:03.107318 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1dbbf0bd-5725-4c93-8a18-81086e0b3b73 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:03.242217 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-1dbbf0bd-5725-4c93-8a18-81086e0b3b73 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:03.250459 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-1dbbf0bd-5725-4c93-8a18-81086e0b3b73 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:03.252055 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-1dbbf0bd-5725-4c93-8a18-81086e0b3b73 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:03.253347 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-1dbbf0bd-5725-4c93-8a18-81086e0b3b73 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 200 len: 1722 microversion: 2.20 time: 0.161264 Sep 20 05:01:03.253982 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 543/693] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:01:03 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 05:01:03.741989 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-666f83ae-17f4-4775-b626-4b05cd4024d3 req-412b80c5-038c-4fe0-af20-359134939994 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d0a9581-09a0-4287-ac5a-260cbfd04a98", "tag": "8a48051c-d8ba-4a69-917d-d7daa79bcd01"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:01:03.751043 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-666f83ae-17f4-4775-b626-4b05cd4024d3 req-412b80c5-038c-4fe0-af20-359134939994 service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:03.751512 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-666f83ae-17f4-4775-b626-4b05cd4024d3 req-412b80c5-038c-4fe0-af20-359134939994 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:03.751934 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-666f83ae-17f4-4775-b626-4b05cd4024d3 req-412b80c5-038c-4fe0-af20-359134939994 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:03.763673 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-666f83ae-17f4-4775-b626-4b05cd4024d3 req-412b80c5-038c-4fe0-af20-359134939994 service nova] Creating event network-changed:8a48051c-d8ba-4a69-917d-d7daa79bcd01 for instance 7d0a9581-09a0-4287-ac5a-260cbfd04a98 on hv-cinder-75671 Sep 20 05:01:03.768499 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-666f83ae-17f4-4775-b626-4b05cd4024d3 req-412b80c5-038c-4fe0-af20-359134939994 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030635 Sep 20 05:01:03.769153 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 544/694] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 05:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 05:01:04.280266 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-9ee1ff0a-e1f8-4067-897b-f950a774be4b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:01:04.281033 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-9ee1ff0a-e1f8-4067-897b-f950a774be4b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:01:04.288197 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9ee1ff0a-e1f8-4067-897b-f950a774be4b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:04.288711 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9ee1ff0a-e1f8-4067-897b-f950a774be4b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:04.289145 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9ee1ff0a-e1f8-4067-897b-f950a774be4b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:04.289844 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9ee1ff0a-e1f8-4067-897b-f950a774be4b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:04.290291 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9ee1ff0a-e1f8-4067-897b-f950a774be4b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:04.290711 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9ee1ff0a-e1f8-4067-897b-f950a774be4b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:04.427808 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-9ee1ff0a-e1f8-4067-897b-f950a774be4b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:04.436439 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-9ee1ff0a-e1f8-4067-897b-f950a774be4b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:04.437929 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-9ee1ff0a-e1f8-4067-897b-f950a774be4b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:04.439121 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-9ee1ff0a-e1f8-4067-897b-f950a774be4b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 200 len: 1722 microversion: 2.20 time: 0.163636 Sep 20 05:01:04.453076 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 545/695] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:01:04 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 05:01:05.463974 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-13bbe6f4-957d-45b4-bbef-b6c227a3eb7c tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:01:05.464666 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-13bbe6f4-957d-45b4-bbef-b6c227a3eb7c tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:01:05.471055 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-13bbe6f4-957d-45b4-bbef-b6c227a3eb7c tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:05.471533 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-13bbe6f4-957d-45b4-bbef-b6c227a3eb7c tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:05.471968 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-13bbe6f4-957d-45b4-bbef-b6c227a3eb7c tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:05.472677 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-13bbe6f4-957d-45b4-bbef-b6c227a3eb7c tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:05.473762 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-13bbe6f4-957d-45b4-bbef-b6c227a3eb7c tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:05.474188 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-13bbe6f4-957d-45b4-bbef-b6c227a3eb7c tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:05.602986 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-13bbe6f4-957d-45b4-bbef-b6c227a3eb7c tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:05.611117 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-13bbe6f4-957d-45b4-bbef-b6c227a3eb7c tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:05.612562 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-13bbe6f4-957d-45b4-bbef-b6c227a3eb7c tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:05.613772 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-13bbe6f4-957d-45b4-bbef-b6c227a3eb7c tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 200 len: 1722 microversion: 2.20 time: 0.153813 Sep 20 05:01:05.614326 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 546/696] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:01:05 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 05:01:06.639163 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-3301e5e3-6ce6-42dd-b7aa-f3d6777f12ce tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:01:06.639774 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-3301e5e3-6ce6-42dd-b7aa-f3d6777f12ce tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:01:06.646562 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3301e5e3-6ce6-42dd-b7aa-f3d6777f12ce tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:06.647035 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3301e5e3-6ce6-42dd-b7aa-f3d6777f12ce tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:06.647471 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3301e5e3-6ce6-42dd-b7aa-f3d6777f12ce tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:06.648149 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3301e5e3-6ce6-42dd-b7aa-f3d6777f12ce tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:06.648620 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3301e5e3-6ce6-42dd-b7aa-f3d6777f12ce tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:06.649038 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3301e5e3-6ce6-42dd-b7aa-f3d6777f12ce tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:06.778272 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-3301e5e3-6ce6-42dd-b7aa-f3d6777f12ce tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:06.787561 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-3301e5e3-6ce6-42dd-b7aa-f3d6777f12ce tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:06.789212 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-3301e5e3-6ce6-42dd-b7aa-f3d6777f12ce tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:06.790384 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-3301e5e3-6ce6-42dd-b7aa-f3d6777f12ce tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 200 len: 1722 microversion: 2.20 time: 0.155386 Sep 20 05:01:06.790962 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 547/697] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:01:06 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 05:01:07.815339 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-5d36c5f4-16ca-45d8-856c-61dd9db3a682 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:01:07.816035 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-5d36c5f4-16ca-45d8-856c-61dd9db3a682 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:01:07.822917 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5d36c5f4-16ca-45d8-856c-61dd9db3a682 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:07.823396 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5d36c5f4-16ca-45d8-856c-61dd9db3a682 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:07.823831 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5d36c5f4-16ca-45d8-856c-61dd9db3a682 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:07.824516 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5d36c5f4-16ca-45d8-856c-61dd9db3a682 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:07.824995 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5d36c5f4-16ca-45d8-856c-61dd9db3a682 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:07.825416 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5d36c5f4-16ca-45d8-856c-61dd9db3a682 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:07.953597 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-5d36c5f4-16ca-45d8-856c-61dd9db3a682 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:07.962407 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-5d36c5f4-16ca-45d8-856c-61dd9db3a682 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:07.963850 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-5d36c5f4-16ca-45d8-856c-61dd9db3a682 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:07.965034 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-5d36c5f4-16ca-45d8-856c-61dd9db3a682 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 200 len: 1722 microversion: 2.20 time: 0.153625 Sep 20 05:01:07.965594 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 548/698] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:01:07 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 05:01:08.990776 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-3826581b-b2e9-4719-9ec0-bc933522db8f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:01:08.991455 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-3826581b-b2e9-4719-9ec0-bc933522db8f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:01:08.997973 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3826581b-b2e9-4719-9ec0-bc933522db8f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:08.998456 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3826581b-b2e9-4719-9ec0-bc933522db8f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:08.998891 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3826581b-b2e9-4719-9ec0-bc933522db8f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:08.999568 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3826581b-b2e9-4719-9ec0-bc933522db8f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:09.000020 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3826581b-b2e9-4719-9ec0-bc933522db8f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:09.000443 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3826581b-b2e9-4719-9ec0-bc933522db8f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:09.130523 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-3826581b-b2e9-4719-9ec0-bc933522db8f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:09.138870 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-3826581b-b2e9-4719-9ec0-bc933522db8f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:09.140305 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-3826581b-b2e9-4719-9ec0-bc933522db8f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:09.141481 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-3826581b-b2e9-4719-9ec0-bc933522db8f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 200 len: 1722 microversion: 2.20 time: 0.155122 Sep 20 05:01:09.142027 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 549/699] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:01:08 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 05:01:10.166465 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-bb15c694-4ec8-4311-b8fc-21410bd765b8 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:01:10.167078 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-bb15c694-4ec8-4311-b8fc-21410bd765b8 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:01:10.173571 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-bb15c694-4ec8-4311-b8fc-21410bd765b8 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:10.174049 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-bb15c694-4ec8-4311-b8fc-21410bd765b8 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:10.174484 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-bb15c694-4ec8-4311-b8fc-21410bd765b8 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:10.175166 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-bb15c694-4ec8-4311-b8fc-21410bd765b8 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:10.175621 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-bb15c694-4ec8-4311-b8fc-21410bd765b8 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:10.176049 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-bb15c694-4ec8-4311-b8fc-21410bd765b8 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:10.304572 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-bb15c694-4ec8-4311-b8fc-21410bd765b8 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:10.312585 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-bb15c694-4ec8-4311-b8fc-21410bd765b8 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:10.314040 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-bb15c694-4ec8-4311-b8fc-21410bd765b8 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:10.315176 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-bb15c694-4ec8-4311-b8fc-21410bd765b8 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 200 len: 1722 microversion: 2.20 time: 0.152752 Sep 20 05:01:10.315755 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 550/700] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:01:10 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 05:01:11.341304 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-990ac646-97d4-430a-9834-aeda1504814f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:01:11.341909 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-990ac646-97d4-430a-9834-aeda1504814f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:01:11.349045 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-990ac646-97d4-430a-9834-aeda1504814f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:11.349521 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-990ac646-97d4-430a-9834-aeda1504814f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:11.349949 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-990ac646-97d4-430a-9834-aeda1504814f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:11.350624 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-990ac646-97d4-430a-9834-aeda1504814f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:11.351072 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-990ac646-97d4-430a-9834-aeda1504814f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:11.351517 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-990ac646-97d4-430a-9834-aeda1504814f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:11.479614 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-990ac646-97d4-430a-9834-aeda1504814f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:11.487992 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-990ac646-97d4-430a-9834-aeda1504814f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:11.489459 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-990ac646-97d4-430a-9834-aeda1504814f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:11.490606 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-990ac646-97d4-430a-9834-aeda1504814f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 200 len: 1722 microversion: 2.20 time: 0.153186 Sep 20 05:01:11.491165 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 551/701] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:01:11 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 05:01:12.515944 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-8bfeda04-7e43-403d-b859-5440e62d1dfc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:01:12.516546 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-8bfeda04-7e43-403d-b859-5440e62d1dfc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:01:12.523430 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8bfeda04-7e43-403d-b859-5440e62d1dfc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:12.523904 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8bfeda04-7e43-403d-b859-5440e62d1dfc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:12.524331 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8bfeda04-7e43-403d-b859-5440e62d1dfc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:12.525063 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8bfeda04-7e43-403d-b859-5440e62d1dfc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:12.525511 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8bfeda04-7e43-403d-b859-5440e62d1dfc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:12.525928 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8bfeda04-7e43-403d-b859-5440e62d1dfc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:12.650291 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-8bfeda04-7e43-403d-b859-5440e62d1dfc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:12.658352 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-8bfeda04-7e43-403d-b859-5440e62d1dfc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:12.659781 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-8bfeda04-7e43-403d-b859-5440e62d1dfc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:12.660952 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-8bfeda04-7e43-403d-b859-5440e62d1dfc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 200 len: 1722 microversion: 2.20 time: 0.149124 Sep 20 05:01:12.661512 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 552/702] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:01:12 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 05:01:13.686201 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-cce0ba35-a297-463d-b0dd-7d3e54b9ef8f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:01:13.686862 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-cce0ba35-a297-463d-b0dd-7d3e54b9ef8f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:01:13.693333 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-cce0ba35-a297-463d-b0dd-7d3e54b9ef8f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:13.693804 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-cce0ba35-a297-463d-b0dd-7d3e54b9ef8f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:13.694433 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-cce0ba35-a297-463d-b0dd-7d3e54b9ef8f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:13.695197 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-cce0ba35-a297-463d-b0dd-7d3e54b9ef8f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:13.695642 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-cce0ba35-a297-463d-b0dd-7d3e54b9ef8f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:13.696265 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-cce0ba35-a297-463d-b0dd-7d3e54b9ef8f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:13.840697 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-cce0ba35-a297-463d-b0dd-7d3e54b9ef8f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:13.848977 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-cce0ba35-a297-463d-b0dd-7d3e54b9ef8f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:13.850571 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-cce0ba35-a297-463d-b0dd-7d3e54b9ef8f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:13.851951 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-cce0ba35-a297-463d-b0dd-7d3e54b9ef8f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 200 len: 1722 microversion: 2.20 time: 0.169494 Sep 20 05:01:13.852503 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 553/703] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:01:13 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 05:01:14.877004 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-58396a4e-c80c-4e8c-b673-224adb3f96b3 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:01:14.877662 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-58396a4e-c80c-4e8c-b673-224adb3f96b3 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:01:14.884211 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-58396a4e-c80c-4e8c-b673-224adb3f96b3 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:14.884718 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-58396a4e-c80c-4e8c-b673-224adb3f96b3 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:14.885153 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-58396a4e-c80c-4e8c-b673-224adb3f96b3 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:14.885838 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-58396a4e-c80c-4e8c-b673-224adb3f96b3 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:14.886288 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-58396a4e-c80c-4e8c-b673-224adb3f96b3 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:14.886964 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-58396a4e-c80c-4e8c-b673-224adb3f96b3 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:15.011034 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-58396a4e-c80c-4e8c-b673-224adb3f96b3 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:15.019828 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-58396a4e-c80c-4e8c-b673-224adb3f96b3 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:15.021327 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-58396a4e-c80c-4e8c-b673-224adb3f96b3 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:15.022488 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-58396a4e-c80c-4e8c-b673-224adb3f96b3 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 200 len: 1722 microversion: 2.20 time: 0.149539 Sep 20 05:01:15.023051 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 554/704] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:01:14 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 05:01:16.047627 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-7dd2bf71-d7b7-4e80-88dd-e357a38474dd tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:01:16.048268 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-7dd2bf71-d7b7-4e80-88dd-e357a38474dd tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:01:16.055510 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7dd2bf71-d7b7-4e80-88dd-e357a38474dd tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:16.055990 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7dd2bf71-d7b7-4e80-88dd-e357a38474dd tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:16.056427 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7dd2bf71-d7b7-4e80-88dd-e357a38474dd tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:16.057137 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7dd2bf71-d7b7-4e80-88dd-e357a38474dd tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:16.057587 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7dd2bf71-d7b7-4e80-88dd-e357a38474dd tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:16.058009 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7dd2bf71-d7b7-4e80-88dd-e357a38474dd tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:16.186885 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-7dd2bf71-d7b7-4e80-88dd-e357a38474dd tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:16.195077 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-7dd2bf71-d7b7-4e80-88dd-e357a38474dd tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:16.196518 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-7dd2bf71-d7b7-4e80-88dd-e357a38474dd tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:16.197694 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-7dd2bf71-d7b7-4e80-88dd-e357a38474dd tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 200 len: 1722 microversion: 2.20 time: 0.154028 Sep 20 05:01:16.198261 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 555/705] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:01:16 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 05:01:17.222617 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-b2a4446b-a97d-4371-b179-9d953ed4a6ba tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:01:17.223322 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-b2a4446b-a97d-4371-b179-9d953ed4a6ba tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:01:17.225646 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:01:17.230846 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b2a4446b-a97d-4371-b179-9d953ed4a6ba tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:17.231322 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b2a4446b-a97d-4371-b179-9d953ed4a6ba tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:17.231758 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b2a4446b-a97d-4371-b179-9d953ed4a6ba tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:17.232441 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b2a4446b-a97d-4371-b179-9d953ed4a6ba tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:17.232924 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b2a4446b-a97d-4371-b179-9d953ed4a6ba tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:17.233350 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b2a4446b-a97d-4371-b179-9d953ed4a6ba tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:17.371094 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-b2a4446b-a97d-4371-b179-9d953ed4a6ba tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:17.379778 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-b2a4446b-a97d-4371-b179-9d953ed4a6ba tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:17.381268 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-b2a4446b-a97d-4371-b179-9d953ed4a6ba tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:17.382426 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-b2a4446b-a97d-4371-b179-9d953ed4a6ba tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 200 len: 1722 microversion: 2.20 time: 0.163772 Sep 20 05:01:17.382983 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 556/706] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:01:17 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 05:01:18.407335 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-51ac04b8-db4c-4e95-9bc1-4cdcf18f8e2e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:01:18.407970 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-51ac04b8-db4c-4e95-9bc1-4cdcf18f8e2e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:01:18.414382 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-51ac04b8-db4c-4e95-9bc1-4cdcf18f8e2e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:18.414863 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-51ac04b8-db4c-4e95-9bc1-4cdcf18f8e2e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:18.415299 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-51ac04b8-db4c-4e95-9bc1-4cdcf18f8e2e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:18.415981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-51ac04b8-db4c-4e95-9bc1-4cdcf18f8e2e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:18.416443 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-51ac04b8-db4c-4e95-9bc1-4cdcf18f8e2e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:18.416886 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-51ac04b8-db4c-4e95-9bc1-4cdcf18f8e2e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:18.542717 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-51ac04b8-db4c-4e95-9bc1-4cdcf18f8e2e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:18.550797 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-51ac04b8-db4c-4e95-9bc1-4cdcf18f8e2e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:18.552239 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-51ac04b8-db4c-4e95-9bc1-4cdcf18f8e2e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:18.553419 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-51ac04b8-db4c-4e95-9bc1-4cdcf18f8e2e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 200 len: 1722 microversion: 2.20 time: 0.150091 Sep 20 05:01:18.553981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 557/707] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:01:18 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 05:01:19.578920 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-10cb038b-6bf0-4e67-8393-f087d652753b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:01:19.579581 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-10cb038b-6bf0-4e67-8393-f087d652753b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:01:19.586712 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-10cb038b-6bf0-4e67-8393-f087d652753b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:19.587193 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-10cb038b-6bf0-4e67-8393-f087d652753b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:19.587630 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-10cb038b-6bf0-4e67-8393-f087d652753b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:19.588327 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-10cb038b-6bf0-4e67-8393-f087d652753b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:19.588812 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-10cb038b-6bf0-4e67-8393-f087d652753b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:19.589242 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-10cb038b-6bf0-4e67-8393-f087d652753b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:19.720385 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-10cb038b-6bf0-4e67-8393-f087d652753b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:19.729215 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-10cb038b-6bf0-4e67-8393-f087d652753b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:19.730618 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-10cb038b-6bf0-4e67-8393-f087d652753b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:19.731793 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-10cb038b-6bf0-4e67-8393-f087d652753b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 200 len: 1743 microversion: 2.20 time: 0.156799 Sep 20 05:01:19.732362 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 558/708] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:01:19 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 05:01:20.756420 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-c7d0d412-8ce6-475e-9043-a55cec5a5df4 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:01:20.757151 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-c7d0d412-8ce6-475e-9043-a55cec5a5df4 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:01:20.763740 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c7d0d412-8ce6-475e-9043-a55cec5a5df4 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:20.764220 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c7d0d412-8ce6-475e-9043-a55cec5a5df4 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:20.764685 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c7d0d412-8ce6-475e-9043-a55cec5a5df4 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:20.765368 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c7d0d412-8ce6-475e-9043-a55cec5a5df4 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:20.765819 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c7d0d412-8ce6-475e-9043-a55cec5a5df4 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:20.766241 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c7d0d412-8ce6-475e-9043-a55cec5a5df4 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:20.770227 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:01:20.906251 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-c7d0d412-8ce6-475e-9043-a55cec5a5df4 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:20.915027 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-c7d0d412-8ce6-475e-9043-a55cec5a5df4 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:20.916570 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-c7d0d412-8ce6-475e-9043-a55cec5a5df4 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:20.917782 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-c7d0d412-8ce6-475e-9043-a55cec5a5df4 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 200 len: 1743 microversion: 2.20 time: 0.165271 Sep 20 05:01:20.918671 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 559/709] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:01:20 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 1743 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 05:01:21.300335 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-dd8876f1-2803-4263-b510-e283912d7144 req-321433b4-5f86-4c42-82cd-606050bc339b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0", "name": "network-vif-plugged", "status": "completed", "tag": "2c6ea4a8-2bc8-407d-bc89-481d40fa0d7f"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:01:21.310551 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-dd8876f1-2803-4263-b510-e283912d7144 req-321433b4-5f86-4c42-82cd-606050bc339b service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:21.311051 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-dd8876f1-2803-4263-b510-e283912d7144 req-321433b4-5f86-4c42-82cd-606050bc339b service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:21.311615 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-dd8876f1-2803-4263-b510-e283912d7144 req-321433b4-5f86-4c42-82cd-606050bc339b service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:21.328221 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-dd8876f1-2803-4263-b510-e283912d7144 req-321433b4-5f86-4c42-82cd-606050bc339b service nova] Creating event network-vif-plugged:2c6ea4a8-2bc8-407d-bc89-481d40fa0d7f for instance 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 on hv-cinder-75671 Sep 20 05:01:21.334719 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-dd8876f1-2803-4263-b510-e283912d7144 req-321433b4-5f86-4c42-82cd-606050bc339b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038184 Sep 20 05:01:21.335679 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 560/710] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 05:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 05:01:21.945783 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-c3f5fcdd-525f-4815-81e7-652aa1fb8e1e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:01:21.947202 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-c3f5fcdd-525f-4815-81e7-652aa1fb8e1e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:01:21.954326 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c3f5fcdd-525f-4815-81e7-652aa1fb8e1e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:21.955173 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c3f5fcdd-525f-4815-81e7-652aa1fb8e1e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:21.955832 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c3f5fcdd-525f-4815-81e7-652aa1fb8e1e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:21.957287 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c3f5fcdd-525f-4815-81e7-652aa1fb8e1e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:21.957825 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c3f5fcdd-525f-4815-81e7-652aa1fb8e1e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:21.958258 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c3f5fcdd-525f-4815-81e7-652aa1fb8e1e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:22.114824 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-c3f5fcdd-525f-4815-81e7-652aa1fb8e1e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:22.123637 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-c3f5fcdd-525f-4815-81e7-652aa1fb8e1e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:22.125389 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-c3f5fcdd-525f-4815-81e7-652aa1fb8e1e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:22.126750 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-c3f5fcdd-525f-4815-81e7-652aa1fb8e1e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 200 len: 1738 microversion: 2.20 time: 0.185835 Sep 20 05:01:22.127301 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 561/711] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:01:21 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 05:01:23.157937 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-140bf163-828b-4bc5-a510-fbc30cab9285 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:01:23.158563 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-140bf163-828b-4bc5-a510-fbc30cab9285 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:01:23.168516 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-140bf163-828b-4bc5-a510-fbc30cab9285 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:23.169728 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-140bf163-828b-4bc5-a510-fbc30cab9285 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:23.170666 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-140bf163-828b-4bc5-a510-fbc30cab9285 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:23.171985 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-140bf163-828b-4bc5-a510-fbc30cab9285 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:23.173073 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-140bf163-828b-4bc5-a510-fbc30cab9285 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:23.173800 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-140bf163-828b-4bc5-a510-fbc30cab9285 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:23.327102 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-140bf163-828b-4bc5-a510-fbc30cab9285 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:23.336278 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-140bf163-828b-4bc5-a510-fbc30cab9285 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:23.337773 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-140bf163-828b-4bc5-a510-fbc30cab9285 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:23.338995 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-140bf163-828b-4bc5-a510-fbc30cab9285 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 200 len: 1738 microversion: 2.20 time: 0.185039 Sep 20 05:01:23.339556 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 562/712] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:01:23 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 05:01:24.365395 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-6a1af738-088e-46e4-a6ba-6ad1a0a689fc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:01:24.366844 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-6a1af738-088e-46e4-a6ba-6ad1a0a689fc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:01:24.373810 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6a1af738-088e-46e4-a6ba-6ad1a0a689fc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:24.374307 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6a1af738-088e-46e4-a6ba-6ad1a0a689fc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:24.374745 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6a1af738-088e-46e4-a6ba-6ad1a0a689fc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:24.375437 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6a1af738-088e-46e4-a6ba-6ad1a0a689fc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:24.375888 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6a1af738-088e-46e4-a6ba-6ad1a0a689fc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:24.376346 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6a1af738-088e-46e4-a6ba-6ad1a0a689fc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:24.514524 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-6a1af738-088e-46e4-a6ba-6ad1a0a689fc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:24.525536 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-6a1af738-088e-46e4-a6ba-6ad1a0a689fc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:24.527117 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-6a1af738-088e-46e4-a6ba-6ad1a0a689fc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:24.528270 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-6a1af738-088e-46e4-a6ba-6ad1a0a689fc tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 200 len: 1738 microversion: 2.20 time: 0.167521 Sep 20 05:01:24.529217 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 563/713] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:01:24 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 1738 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 05:01:25.555020 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-e1048e96-6413-4e53-9194-8667bade3dfb tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:01:25.555676 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-e1048e96-6413-4e53-9194-8667bade3dfb tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:01:25.562478 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e1048e96-6413-4e53-9194-8667bade3dfb tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:25.562963 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e1048e96-6413-4e53-9194-8667bade3dfb tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:25.563411 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e1048e96-6413-4e53-9194-8667bade3dfb tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:25.564122 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e1048e96-6413-4e53-9194-8667bade3dfb tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:25.564582 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e1048e96-6413-4e53-9194-8667bade3dfb tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:25.565065 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e1048e96-6413-4e53-9194-8667bade3dfb tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:25.716996 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-e1048e96-6413-4e53-9194-8667bade3dfb tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:25.726807 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-e1048e96-6413-4e53-9194-8667bade3dfb tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:25.728572 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-e1048e96-6413-4e53-9194-8667bade3dfb tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:25.729970 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-e1048e96-6413-4e53-9194-8667bade3dfb tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 200 len: 1738 microversion: 2.20 time: 0.179744 Sep 20 05:01:25.730736 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 564/714] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:01:25 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 05:01:26.757071 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-bfdf06d4-b6e4-4640-96fa-11a2b385c038 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:01:26.758008 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-bfdf06d4-b6e4-4640-96fa-11a2b385c038 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:01:26.764790 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-bfdf06d4-b6e4-4640-96fa-11a2b385c038 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:26.765284 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-bfdf06d4-b6e4-4640-96fa-11a2b385c038 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:26.765748 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-bfdf06d4-b6e4-4640-96fa-11a2b385c038 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:26.766482 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-bfdf06d4-b6e4-4640-96fa-11a2b385c038 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:26.766964 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-bfdf06d4-b6e4-4640-96fa-11a2b385c038 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:26.767418 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-bfdf06d4-b6e4-4640-96fa-11a2b385c038 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:26.921135 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-bfdf06d4-b6e4-4640-96fa-11a2b385c038 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:26.933122 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-bfdf06d4-b6e4-4640-96fa-11a2b385c038 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:26.934648 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-bfdf06d4-b6e4-4640-96fa-11a2b385c038 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:26.935847 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-bfdf06d4-b6e4-4640-96fa-11a2b385c038 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 200 len: 1738 microversion: 2.20 time: 0.183583 Sep 20 05:01:26.936407 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 565/715] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:01:26 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 1738 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 05:01:27.967875 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-ea4667c8-f4b5-41ee-bca0-ec4f47973486 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:01:27.968847 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-ea4667c8-f4b5-41ee-bca0-ec4f47973486 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:01:27.975865 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ea4667c8-f4b5-41ee-bca0-ec4f47973486 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:27.976344 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ea4667c8-f4b5-41ee-bca0-ec4f47973486 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:27.976800 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ea4667c8-f4b5-41ee-bca0-ec4f47973486 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:27.977510 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ea4667c8-f4b5-41ee-bca0-ec4f47973486 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:27.977941 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ea4667c8-f4b5-41ee-bca0-ec4f47973486 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:27.978362 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ea4667c8-f4b5-41ee-bca0-ec4f47973486 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:28.138396 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-ea4667c8-f4b5-41ee-bca0-ec4f47973486 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:28.148702 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-ea4667c8-f4b5-41ee-bca0-ec4f47973486 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:28.152988 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-ea4667c8-f4b5-41ee-bca0-ec4f47973486 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:28.152988 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-ea4667c8-f4b5-41ee-bca0-ec4f47973486 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 200 len: 1738 microversion: 2.20 time: 0.191209 Sep 20 05:01:28.173756 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 566/716] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:01:27 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 1738 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 05:01:29.181251 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-d77df4be-3a1f-46d0-b577-b1de39a4bf0d tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:01:29.181989 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-d77df4be-3a1f-46d0-b577-b1de39a4bf0d tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:01:29.188853 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d77df4be-3a1f-46d0-b577-b1de39a4bf0d tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:29.189358 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d77df4be-3a1f-46d0-b577-b1de39a4bf0d tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:29.189781 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d77df4be-3a1f-46d0-b577-b1de39a4bf0d tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:29.190500 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d77df4be-3a1f-46d0-b577-b1de39a4bf0d tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:29.190946 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d77df4be-3a1f-46d0-b577-b1de39a4bf0d tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:29.191371 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d77df4be-3a1f-46d0-b577-b1de39a4bf0d tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:29.330606 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-d77df4be-3a1f-46d0-b577-b1de39a4bf0d tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:29.339394 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-d77df4be-3a1f-46d0-b577-b1de39a4bf0d tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:29.341084 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-d77df4be-3a1f-46d0-b577-b1de39a4bf0d tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:29.342035 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-d77df4be-3a1f-46d0-b577-b1de39a4bf0d tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 200 len: 1738 microversion: 2.20 time: 0.164734 Sep 20 05:01:29.342610 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 567/717] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:01:29 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 05:01:30.372195 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-fa6601df-7565-4340-ac19-983137238b99 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:01:30.372855 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-fa6601df-7565-4340-ac19-983137238b99 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:01:30.379437 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fa6601df-7565-4340-ac19-983137238b99 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:30.379930 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fa6601df-7565-4340-ac19-983137238b99 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:30.380352 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fa6601df-7565-4340-ac19-983137238b99 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:30.381066 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fa6601df-7565-4340-ac19-983137238b99 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:30.381516 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fa6601df-7565-4340-ac19-983137238b99 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:30.381938 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fa6601df-7565-4340-ac19-983137238b99 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:30.507194 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-fa6601df-7565-4340-ac19-983137238b99 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:30.515510 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-fa6601df-7565-4340-ac19-983137238b99 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:30.516976 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-fa6601df-7565-4340-ac19-983137238b99 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:30.518125 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-fa6601df-7565-4340-ac19-983137238b99 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 200 len: 1738 microversion: 2.20 time: 0.149927 Sep 20 05:01:30.518686 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 568/718] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:01:30 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 05:01:31.543313 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-03f48ecd-9410-4635-b252-0804725f48c6 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:01:31.543913 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-03f48ecd-9410-4635-b252-0804725f48c6 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:01:31.550298 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-03f48ecd-9410-4635-b252-0804725f48c6 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:31.550784 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-03f48ecd-9410-4635-b252-0804725f48c6 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:31.551732 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-03f48ecd-9410-4635-b252-0804725f48c6 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:31.552410 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-03f48ecd-9410-4635-b252-0804725f48c6 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:31.552907 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-03f48ecd-9410-4635-b252-0804725f48c6 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:31.553333 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-03f48ecd-9410-4635-b252-0804725f48c6 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:31.685022 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-03f48ecd-9410-4635-b252-0804725f48c6 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:31.693615 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-03f48ecd-9410-4635-b252-0804725f48c6 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:31.695051 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-03f48ecd-9410-4635-b252-0804725f48c6 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:31.696201 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-03f48ecd-9410-4635-b252-0804725f48c6 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 200 len: 1720 microversion: 2.20 time: 0.156871 Sep 20 05:01:31.696789 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 569/719] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:01:31 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 05:01:32.721436 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-58b9383a-2cd2-400e-a384-78daedbf2796 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:01:32.722066 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-58b9383a-2cd2-400e-a384-78daedbf2796 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:01:32.728504 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-58b9383a-2cd2-400e-a384-78daedbf2796 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:32.729007 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-58b9383a-2cd2-400e-a384-78daedbf2796 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:32.729444 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-58b9383a-2cd2-400e-a384-78daedbf2796 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:32.730121 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-58b9383a-2cd2-400e-a384-78daedbf2796 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:32.730568 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-58b9383a-2cd2-400e-a384-78daedbf2796 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:32.730986 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-58b9383a-2cd2-400e-a384-78daedbf2796 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:32.859544 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-58b9383a-2cd2-400e-a384-78daedbf2796 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:32.868403 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-58b9383a-2cd2-400e-a384-78daedbf2796 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:32.869867 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-58b9383a-2cd2-400e-a384-78daedbf2796 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:32.871017 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-58b9383a-2cd2-400e-a384-78daedbf2796 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 200 len: 1720 microversion: 2.20 time: 0.153538 Sep 20 05:01:32.871564 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 570/720] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:01:32 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 05:01:33.312455 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-468c3a72-2434-42a6-a644-0d4a6fa4ff61 req-952f0b6b-e2ec-4bec-b742-69b50c09e90a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0", "name": "network-vif-unplugged", "status": "completed", "tag": "2c6ea4a8-2bc8-407d-bc89-481d40fa0d7f"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:01:33.323028 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-468c3a72-2434-42a6-a644-0d4a6fa4ff61 req-952f0b6b-e2ec-4bec-b742-69b50c09e90a service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:33.323943 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-468c3a72-2434-42a6-a644-0d4a6fa4ff61 req-952f0b6b-e2ec-4bec-b742-69b50c09e90a service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:33.324638 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-468c3a72-2434-42a6-a644-0d4a6fa4ff61 req-952f0b6b-e2ec-4bec-b742-69b50c09e90a service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:33.337989 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-468c3a72-2434-42a6-a644-0d4a6fa4ff61 req-952f0b6b-e2ec-4bec-b742-69b50c09e90a service nova] Creating event network-vif-unplugged:2c6ea4a8-2bc8-407d-bc89-481d40fa0d7f for instance 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 on hv-cinder-75671 Sep 20 05:01:33.343496 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-468c3a72-2434-42a6-a644-0d4a6fa4ff61 req-952f0b6b-e2ec-4bec-b742-69b50c09e90a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034822 Sep 20 05:01:33.344379 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 571/721] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 05:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 05:01:33.898465 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-80e9141f-aaa2-4216-a61d-5310cda36331 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:01:33.899142 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-80e9141f-aaa2-4216-a61d-5310cda36331 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:01:33.905266 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-80e9141f-aaa2-4216-a61d-5310cda36331 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:33.905745 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-80e9141f-aaa2-4216-a61d-5310cda36331 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:33.906187 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-80e9141f-aaa2-4216-a61d-5310cda36331 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:33.906870 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-80e9141f-aaa2-4216-a61d-5310cda36331 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:33.907319 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-80e9141f-aaa2-4216-a61d-5310cda36331 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:33.907739 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-80e9141f-aaa2-4216-a61d-5310cda36331 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:34.037850 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-80e9141f-aaa2-4216-a61d-5310cda36331 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:34.046024 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-80e9141f-aaa2-4216-a61d-5310cda36331 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:34.047463 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-80e9141f-aaa2-4216-a61d-5310cda36331 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:34.048634 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-80e9141f-aaa2-4216-a61d-5310cda36331 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 200 len: 1663 microversion: 2.20 time: 0.155422 Sep 20 05:01:34.049200 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 572/722] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:01:33 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 1663 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 05:01:34.073171 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-1e6bc9ef-1865-4bf4-bae0-d576973a2dea tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a9fb239-075f-41cc-940c-adf6085e899c"}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:01:34.075451 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-1e6bc9ef-1865-4bf4-bae0-d576973a2dea tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:01:34.081127 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1e6bc9ef-1865-4bf4-bae0-d576973a2dea tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:34.081608 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1e6bc9ef-1865-4bf4-bae0-d576973a2dea tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:34.082659 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1e6bc9ef-1865-4bf4-bae0-d576973a2dea tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:34.083345 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1e6bc9ef-1865-4bf4-bae0-d576973a2dea tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:34.083800 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1e6bc9ef-1865-4bf4-bae0-d576973a2dea tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:34.084226 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1e6bc9ef-1865-4bf4-bae0-d576973a2dea tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:34.342802 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-1e6bc9ef-1865-4bf4-bae0-d576973a2dea tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "POST /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.273203 Sep 20 05:01:34.343407 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 573/723] 10.222.0.27 () {62 vars in 1364 bytes} [Tue Sep 20 05:01:34 2022] POST /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0/os-volume_attachments => generated 188 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 20 05:01:34.466217 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-c4c1cdb3-e820-4f60-b556-79811707b5a9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:01:34.466710 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-c4c1cdb3-e820-4f60-b556-79811707b5a9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:01:34.472630 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c4c1cdb3-e820-4f60-b556-79811707b5a9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:34.473121 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c4c1cdb3-e820-4f60-b556-79811707b5a9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:34.473556 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c4c1cdb3-e820-4f60-b556-79811707b5a9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:34.474241 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c4c1cdb3-e820-4f60-b556-79811707b5a9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:34.474692 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c4c1cdb3-e820-4f60-b556-79811707b5a9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:34.475116 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c4c1cdb3-e820-4f60-b556-79811707b5a9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:34.493037 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:01:34.712427 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-c4c1cdb3-e820-4f60-b556-79811707b5a9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0/os-volume_attachments/6a9fb239-075f-41cc-940c-adf6085e899c" status: 202 len: 0 microversion: 2.20 time: 0.250105 Sep 20 05:01:34.713236 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 574/724] 10.222.0.27 () {60 vars in 1457 bytes} [Tue Sep 20 05:01:34 2022] DELETE /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0/os-volume_attachments/6a9fb239-075f-41cc-940c-adf6085e899c => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 20 05:01:34.772901 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-ef450131-884e-4b99-b363-5a1d206fa4bf tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:01:34.773505 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-ef450131-884e-4b99-b363-5a1d206fa4bf tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:01:34.779412 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ef450131-884e-4b99-b363-5a1d206fa4bf tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:34.779888 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ef450131-884e-4b99-b363-5a1d206fa4bf tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:34.780321 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ef450131-884e-4b99-b363-5a1d206fa4bf tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:34.781044 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ef450131-884e-4b99-b363-5a1d206fa4bf tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:34.781495 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ef450131-884e-4b99-b363-5a1d206fa4bf tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:34.781919 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ef450131-884e-4b99-b363-5a1d206fa4bf tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:34.811518 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-ef450131-884e-4b99-b363-5a1d206fa4bf tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126813) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 20 05:01:34.878472 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-ef450131-884e-4b99-b363-5a1d206fa4bf tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "POST /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0/action" status: 202 len: 0 microversion: 2.20 time: 0.109443 Sep 20 05:01:34.879115 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 575/725] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Sep 20 05:01:34 2022] POST /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 20 05:01:34.887125 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-daa6676d-8fb1-4ee1-b84f-fc6b864a9f90 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:01:34.887737 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-daa6676d-8fb1-4ee1-b84f-fc6b864a9f90 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:01:34.893682 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-daa6676d-8fb1-4ee1-b84f-fc6b864a9f90 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:34.894170 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-daa6676d-8fb1-4ee1-b84f-fc6b864a9f90 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:34.894607 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-daa6676d-8fb1-4ee1-b84f-fc6b864a9f90 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:34.895300 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-daa6676d-8fb1-4ee1-b84f-fc6b864a9f90 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:34.895754 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-daa6676d-8fb1-4ee1-b84f-fc6b864a9f90 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:34.896181 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-daa6676d-8fb1-4ee1-b84f-fc6b864a9f90 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:35.032450 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-daa6676d-8fb1-4ee1-b84f-fc6b864a9f90 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:35.041367 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-daa6676d-8fb1-4ee1-b84f-fc6b864a9f90 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:35.042891 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-daa6676d-8fb1-4ee1-b84f-fc6b864a9f90 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:35.044048 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-daa6676d-8fb1-4ee1-b84f-fc6b864a9f90 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 200 len: 1671 microversion: 2.20 time: 0.160885 Sep 20 05:01:35.044625 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 576/726] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:01:34 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 1671 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 05:01:36.070246 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-6faf5795-782c-4cf1-9c37-35f1772cd0e2 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:01:36.070868 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-6faf5795-782c-4cf1-9c37-35f1772cd0e2 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:01:36.077254 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6faf5795-782c-4cf1-9c37-35f1772cd0e2 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:36.077744 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6faf5795-782c-4cf1-9c37-35f1772cd0e2 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:36.078185 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6faf5795-782c-4cf1-9c37-35f1772cd0e2 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:36.078877 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6faf5795-782c-4cf1-9c37-35f1772cd0e2 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:36.079335 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6faf5795-782c-4cf1-9c37-35f1772cd0e2 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:36.079766 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6faf5795-782c-4cf1-9c37-35f1772cd0e2 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:36.214857 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-6faf5795-782c-4cf1-9c37-35f1772cd0e2 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:36.223560 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-6faf5795-782c-4cf1-9c37-35f1772cd0e2 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:36.225044 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-6faf5795-782c-4cf1-9c37-35f1772cd0e2 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:36.226204 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-6faf5795-782c-4cf1-9c37-35f1772cd0e2 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 200 len: 1729 microversion: 2.20 time: 0.160802 Sep 20 05:01:36.226762 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 577/727] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:01:36 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 05:01:37.252062 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-8a17799e-4992-4f73-8472-6df0c63ca94c tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:01:37.252781 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-8a17799e-4992-4f73-8472-6df0c63ca94c tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:01:37.259309 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8a17799e-4992-4f73-8472-6df0c63ca94c tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:37.259872 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8a17799e-4992-4f73-8472-6df0c63ca94c tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:37.260400 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8a17799e-4992-4f73-8472-6df0c63ca94c tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:37.261213 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8a17799e-4992-4f73-8472-6df0c63ca94c tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:37.261952 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8a17799e-4992-4f73-8472-6df0c63ca94c tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:37.262380 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8a17799e-4992-4f73-8472-6df0c63ca94c tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:37.410958 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-8a17799e-4992-4f73-8472-6df0c63ca94c tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:37.424834 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-8a17799e-4992-4f73-8472-6df0c63ca94c tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:37.428284 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-8a17799e-4992-4f73-8472-6df0c63ca94c tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:37.430919 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-8a17799e-4992-4f73-8472-6df0c63ca94c tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 200 len: 1729 microversion: 2.20 time: 0.182248 Sep 20 05:01:37.458301 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 578/728] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:01:37 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 1729 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 05:01:38.465905 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-30895af5-17cb-422c-b68e-fcff6b11e67e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:01:38.467344 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-30895af5-17cb-422c-b68e-fcff6b11e67e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:01:38.474342 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-30895af5-17cb-422c-b68e-fcff6b11e67e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:38.474937 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-30895af5-17cb-422c-b68e-fcff6b11e67e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:38.475433 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-30895af5-17cb-422c-b68e-fcff6b11e67e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:38.476196 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-30895af5-17cb-422c-b68e-fcff6b11e67e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:38.476753 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-30895af5-17cb-422c-b68e-fcff6b11e67e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:38.477174 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-30895af5-17cb-422c-b68e-fcff6b11e67e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:38.620346 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-30895af5-17cb-422c-b68e-fcff6b11e67e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:38.629908 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-30895af5-17cb-422c-b68e-fcff6b11e67e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:38.631421 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-30895af5-17cb-422c-b68e-fcff6b11e67e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:38.632613 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-30895af5-17cb-422c-b68e-fcff6b11e67e tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 200 len: 1729 microversion: 2.20 time: 0.170948 Sep 20 05:01:38.633261 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 579/729] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:01:38 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 05:01:39.658444 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-bd345678-1ccf-471c-bc1d-59a2f93fa178 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:01:39.659116 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-bd345678-1ccf-471c-bc1d-59a2f93fa178 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:01:39.665815 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-bd345678-1ccf-471c-bc1d-59a2f93fa178 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:39.666302 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-bd345678-1ccf-471c-bc1d-59a2f93fa178 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:39.666741 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-bd345678-1ccf-471c-bc1d-59a2f93fa178 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:39.667440 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-bd345678-1ccf-471c-bc1d-59a2f93fa178 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:39.667896 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-bd345678-1ccf-471c-bc1d-59a2f93fa178 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:39.668327 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-bd345678-1ccf-471c-bc1d-59a2f93fa178 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:39.811583 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-bd345678-1ccf-471c-bc1d-59a2f93fa178 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:39.820550 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-bd345678-1ccf-471c-bc1d-59a2f93fa178 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:39.822004 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-bd345678-1ccf-471c-bc1d-59a2f93fa178 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:39.823158 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-bd345678-1ccf-471c-bc1d-59a2f93fa178 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 200 len: 1729 microversion: 2.20 time: 0.168665 Sep 20 05:01:39.823713 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 580/730] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:01:39 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 05:01:40.848058 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-18835e0f-6638-4654-9328-3e45f15244f8 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:01:40.848853 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-18835e0f-6638-4654-9328-3e45f15244f8 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:01:40.856863 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-18835e0f-6638-4654-9328-3e45f15244f8 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:40.857352 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-18835e0f-6638-4654-9328-3e45f15244f8 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:40.857789 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-18835e0f-6638-4654-9328-3e45f15244f8 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:40.858496 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-18835e0f-6638-4654-9328-3e45f15244f8 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:40.858942 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-18835e0f-6638-4654-9328-3e45f15244f8 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:40.859361 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-18835e0f-6638-4654-9328-3e45f15244f8 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:41.005492 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-18835e0f-6638-4654-9328-3e45f15244f8 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:41.014480 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-18835e0f-6638-4654-9328-3e45f15244f8 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:41.015995 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-18835e0f-6638-4654-9328-3e45f15244f8 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:41.017273 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-18835e0f-6638-4654-9328-3e45f15244f8 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 200 len: 1729 microversion: 2.20 time: 0.173076 Sep 20 05:01:41.017861 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 581/731] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:01:40 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 05:01:42.042031 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-2d3f78b5-5cdc-45fb-8529-460ddf066ae1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:01:42.042723 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-2d3f78b5-5cdc-45fb-8529-460ddf066ae1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:01:42.049710 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2d3f78b5-5cdc-45fb-8529-460ddf066ae1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:42.049995 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2d3f78b5-5cdc-45fb-8529-460ddf066ae1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:42.050937 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2d3f78b5-5cdc-45fb-8529-460ddf066ae1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:42.051631 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2d3f78b5-5cdc-45fb-8529-460ddf066ae1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:42.052301 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2d3f78b5-5cdc-45fb-8529-460ddf066ae1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:42.052763 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2d3f78b5-5cdc-45fb-8529-460ddf066ae1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:42.198948 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-2d3f78b5-5cdc-45fb-8529-460ddf066ae1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:42.207479 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-2d3f78b5-5cdc-45fb-8529-460ddf066ae1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:42.208988 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-2d3f78b5-5cdc-45fb-8529-460ddf066ae1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:42.210179 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-2d3f78b5-5cdc-45fb-8529-460ddf066ae1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 200 len: 1729 microversion: 2.20 time: 0.172039 Sep 20 05:01:42.211070 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 582/732] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:01:42 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 05:01:43.237848 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-8ea76872-331c-455d-91a1-7b6cb347beda tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:01:43.239129 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-8ea76872-331c-455d-91a1-7b6cb347beda tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:01:43.245643 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8ea76872-331c-455d-91a1-7b6cb347beda tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:43.246127 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8ea76872-331c-455d-91a1-7b6cb347beda tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:43.246590 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8ea76872-331c-455d-91a1-7b6cb347beda tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:43.247281 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8ea76872-331c-455d-91a1-7b6cb347beda tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:43.247741 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8ea76872-331c-455d-91a1-7b6cb347beda tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:43.248167 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8ea76872-331c-455d-91a1-7b6cb347beda tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:43.384319 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-8ea76872-331c-455d-91a1-7b6cb347beda tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:43.393198 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-8ea76872-331c-455d-91a1-7b6cb347beda tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:43.395276 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-8ea76872-331c-455d-91a1-7b6cb347beda tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:43.396444 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-8ea76872-331c-455d-91a1-7b6cb347beda tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 200 len: 1729 microversion: 2.20 time: 0.162535 Sep 20 05:01:43.397071 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 583/733] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:01:43 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 05:01:44.422388 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-957847e4-4209-4b33-8666-442c8897b28c tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:01:44.423288 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-957847e4-4209-4b33-8666-442c8897b28c tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:01:44.429957 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-957847e4-4209-4b33-8666-442c8897b28c tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:44.430629 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-957847e4-4209-4b33-8666-442c8897b28c tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:44.431073 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-957847e4-4209-4b33-8666-442c8897b28c tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:44.431778 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-957847e4-4209-4b33-8666-442c8897b28c tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:44.432245 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-957847e4-4209-4b33-8666-442c8897b28c tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:44.432697 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-957847e4-4209-4b33-8666-442c8897b28c tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:44.574617 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-957847e4-4209-4b33-8666-442c8897b28c tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:44.583731 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-957847e4-4209-4b33-8666-442c8897b28c tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:44.585268 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-957847e4-4209-4b33-8666-442c8897b28c tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:44.586405 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-957847e4-4209-4b33-8666-442c8897b28c tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 200 len: 1729 microversion: 2.20 time: 0.168670 Sep 20 05:01:44.586957 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 584/734] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:01:44 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 05:01:45.612098 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-ae93cf58-009b-49f8-8b32-9488b3ded4fe tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:01:45.612855 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-ae93cf58-009b-49f8-8b32-9488b3ded4fe tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:01:45.619664 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ae93cf58-009b-49f8-8b32-9488b3ded4fe tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:45.620146 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ae93cf58-009b-49f8-8b32-9488b3ded4fe tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:45.620574 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ae93cf58-009b-49f8-8b32-9488b3ded4fe tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:45.621270 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ae93cf58-009b-49f8-8b32-9488b3ded4fe tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:45.621714 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ae93cf58-009b-49f8-8b32-9488b3ded4fe tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:45.622133 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ae93cf58-009b-49f8-8b32-9488b3ded4fe tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:45.749291 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-ae93cf58-009b-49f8-8b32-9488b3ded4fe tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:45.757354 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-ae93cf58-009b-49f8-8b32-9488b3ded4fe tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:45.758785 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-ae93cf58-009b-49f8-8b32-9488b3ded4fe tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:45.759928 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-ae93cf58-009b-49f8-8b32-9488b3ded4fe tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 200 len: 1729 microversion: 2.20 time: 0.151707 Sep 20 05:01:45.760473 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 585/735] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:01:45 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 05:01:46.785751 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-b62bda7d-b116-4e68-b76c-e7f434b4a2ea tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:01:46.786342 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-b62bda7d-b116-4e68-b76c-e7f434b4a2ea tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:01:46.792879 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b62bda7d-b116-4e68-b76c-e7f434b4a2ea tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:46.793353 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b62bda7d-b116-4e68-b76c-e7f434b4a2ea tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:46.793782 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b62bda7d-b116-4e68-b76c-e7f434b4a2ea tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:46.794457 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b62bda7d-b116-4e68-b76c-e7f434b4a2ea tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:46.794913 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b62bda7d-b116-4e68-b76c-e7f434b4a2ea tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:46.795326 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b62bda7d-b116-4e68-b76c-e7f434b4a2ea tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:46.924759 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-b62bda7d-b116-4e68-b76c-e7f434b4a2ea tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:46.933057 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-b62bda7d-b116-4e68-b76c-e7f434b4a2ea tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:46.934658 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-b62bda7d-b116-4e68-b76c-e7f434b4a2ea tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:46.935873 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-b62bda7d-b116-4e68-b76c-e7f434b4a2ea tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 200 len: 1729 microversion: 2.20 time: 0.154014 Sep 20 05:01:46.936710 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 586/736] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:01:46 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 05:01:47.961914 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-b44d04c9-ea32-4640-ba1a-2b44d97943b9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:01:47.962584 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-b44d04c9-ea32-4640-ba1a-2b44d97943b9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:01:47.964849 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:01:47.970109 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b44d04c9-ea32-4640-ba1a-2b44d97943b9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:47.970584 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b44d04c9-ea32-4640-ba1a-2b44d97943b9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:47.971017 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b44d04c9-ea32-4640-ba1a-2b44d97943b9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:47.971695 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b44d04c9-ea32-4640-ba1a-2b44d97943b9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:47.972833 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b44d04c9-ea32-4640-ba1a-2b44d97943b9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:47.973258 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b44d04c9-ea32-4640-ba1a-2b44d97943b9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:48.111147 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-b44d04c9-ea32-4640-ba1a-2b44d97943b9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:48.113360 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:01:48.120884 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-b44d04c9-ea32-4640-ba1a-2b44d97943b9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:48.122314 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-b44d04c9-ea32-4640-ba1a-2b44d97943b9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:48.123459 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-b44d04c9-ea32-4640-ba1a-2b44d97943b9 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 200 len: 1729 microversion: 2.20 time: 0.165467 Sep 20 05:01:48.124016 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 587/737] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:01:47 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 05:01:49.148577 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-89cd3efd-6513-4d96-ba82-83be84fd0338 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:01:49.149237 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-89cd3efd-6513-4d96-ba82-83be84fd0338 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:01:49.157291 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-89cd3efd-6513-4d96-ba82-83be84fd0338 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:49.157782 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-89cd3efd-6513-4d96-ba82-83be84fd0338 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:49.158226 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-89cd3efd-6513-4d96-ba82-83be84fd0338 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:49.158942 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-89cd3efd-6513-4d96-ba82-83be84fd0338 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:49.159459 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-89cd3efd-6513-4d96-ba82-83be84fd0338 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:49.159886 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-89cd3efd-6513-4d96-ba82-83be84fd0338 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:49.291700 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-89cd3efd-6513-4d96-ba82-83be84fd0338 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:49.299907 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-89cd3efd-6513-4d96-ba82-83be84fd0338 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:49.301391 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-89cd3efd-6513-4d96-ba82-83be84fd0338 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:49.302566 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-89cd3efd-6513-4d96-ba82-83be84fd0338 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 200 len: 1729 microversion: 2.20 time: 0.158651 Sep 20 05:01:49.308642 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 588/738] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:01:49 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 05:01:49.435898 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-ef8a3fb0-c8e0-4340-8250-c6be16112b68 req-6b4dd337-8fe9-433f-a76d-250397877b32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0", "name": "network-vif-plugged", "status": "completed", "tag": "2c6ea4a8-2bc8-407d-bc89-481d40fa0d7f"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:01:49.447000 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-ef8a3fb0-c8e0-4340-8250-c6be16112b68 req-6b4dd337-8fe9-433f-a76d-250397877b32 service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:49.447484 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-ef8a3fb0-c8e0-4340-8250-c6be16112b68 req-6b4dd337-8fe9-433f-a76d-250397877b32 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:49.447915 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-ef8a3fb0-c8e0-4340-8250-c6be16112b68 req-6b4dd337-8fe9-433f-a76d-250397877b32 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:49.459374 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-ef8a3fb0-c8e0-4340-8250-c6be16112b68 req-6b4dd337-8fe9-433f-a76d-250397877b32 service nova] Creating event network-vif-plugged:2c6ea4a8-2bc8-407d-bc89-481d40fa0d7f for instance 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 on hv-cinder-75671 Sep 20 05:01:49.464783 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-ef8a3fb0-c8e0-4340-8250-c6be16112b68 req-6b4dd337-8fe9-433f-a76d-250397877b32 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032547 Sep 20 05:01:49.465529 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 589/739] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 05:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 05:01:50.334232 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-bf9cc825-605b-4e8c-8e24-c24109157dd5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:01:50.335830 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-bf9cc825-605b-4e8c-8e24-c24109157dd5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:01:50.346576 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-bf9cc825-605b-4e8c-8e24-c24109157dd5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:50.348383 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-bf9cc825-605b-4e8c-8e24-c24109157dd5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:50.349328 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-bf9cc825-605b-4e8c-8e24-c24109157dd5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:50.350022 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-bf9cc825-605b-4e8c-8e24-c24109157dd5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:50.351089 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-bf9cc825-605b-4e8c-8e24-c24109157dd5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:50.352100 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-bf9cc825-605b-4e8c-8e24-c24109157dd5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:50.501771 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-bf9cc825-605b-4e8c-8e24-c24109157dd5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:50.510481 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-bf9cc825-605b-4e8c-8e24-c24109157dd5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:50.512172 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-bf9cc825-605b-4e8c-8e24-c24109157dd5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:50.513360 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-bf9cc825-605b-4e8c-8e24-c24109157dd5 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 200 len: 1729 microversion: 2.20 time: 0.188290 Sep 20 05:01:50.513919 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 590/740] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:01:50 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 1729 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 05:01:51.540063 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-2f221f43-cec9-49d0-81d4-2a277c4cba42 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:01:51.540719 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-2f221f43-cec9-49d0-81d4-2a277c4cba42 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:01:51.547258 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2f221f43-cec9-49d0-81d4-2a277c4cba42 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:51.547755 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2f221f43-cec9-49d0-81d4-2a277c4cba42 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:51.548194 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2f221f43-cec9-49d0-81d4-2a277c4cba42 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:51.548925 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2f221f43-cec9-49d0-81d4-2a277c4cba42 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:51.549383 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2f221f43-cec9-49d0-81d4-2a277c4cba42 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:51.550416 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2f221f43-cec9-49d0-81d4-2a277c4cba42 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:51.684802 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-2f221f43-cec9-49d0-81d4-2a277c4cba42 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:51.693462 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-2f221f43-cec9-49d0-81d4-2a277c4cba42 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:51.694809 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-2f221f43-cec9-49d0-81d4-2a277c4cba42 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:51.695964 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-2f221f43-cec9-49d0-81d4-2a277c4cba42 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 200 len: 1729 microversion: 2.20 time: 0.159979 Sep 20 05:01:51.696522 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 591/741] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:01:51 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 05:01:52.720720 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-d5c9746f-180a-45c0-9fd2-97e489e188b8 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:01:52.721369 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-d5c9746f-180a-45c0-9fd2-97e489e188b8 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:01:52.728455 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d5c9746f-180a-45c0-9fd2-97e489e188b8 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:52.728966 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d5c9746f-180a-45c0-9fd2-97e489e188b8 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:52.729400 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d5c9746f-180a-45c0-9fd2-97e489e188b8 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:52.730076 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d5c9746f-180a-45c0-9fd2-97e489e188b8 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:01:52.730521 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d5c9746f-180a-45c0-9fd2-97e489e188b8 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:01:52.730937 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d5c9746f-180a-45c0-9fd2-97e489e188b8 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:01:52.859969 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-d5c9746f-180a-45c0-9fd2-97e489e188b8 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:52.868858 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-d5c9746f-180a-45c0-9fd2-97e489e188b8 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:52.870307 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-d5c9746f-180a-45c0-9fd2-97e489e188b8 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:01:52.871474 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-d5c9746f-180a-45c0-9fd2-97e489e188b8 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 200 len: 1716 microversion: 2.20 time: 0.154718 Sep 20 05:01:52.872045 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 592/742] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:01:52 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 1716 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 05:01:55.243069 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 20 05:01:55.243577 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: Tue Sep 20 05:01:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.27) !!! Sep 20 05:02:25.409342 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-0f21eebd-aef0-4e3f-b9bc-773b88c76044 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:02:25.411972 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-0f21eebd-aef0-4e3f-b9bc-773b88c76044 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:02:25.414430 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_api:SELECT=11 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:25.415284 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell1:SELECT=27 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:25.420716 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0f21eebd-aef0-4e3f-b9bc-773b88c76044 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:25.421198 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0f21eebd-aef0-4e3f-b9bc-773b88c76044 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:25.421635 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0f21eebd-aef0-4e3f-b9bc-773b88c76044 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:25.422326 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0f21eebd-aef0-4e3f-b9bc-773b88c76044 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:25.422782 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0f21eebd-aef0-4e3f-b9bc-773b88c76044 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:25.423207 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0f21eebd-aef0-4e3f-b9bc-773b88c76044 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:25.452434 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-0f21eebd-aef0-4e3f-b9bc-773b88c76044 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047165 Sep 20 05:02:25.453018 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 593/743] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Sep 20 05:02:25 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 05:02:25.514693 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-7e4b3d21-0c13-4b33-a630-f35b3522e519 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:02:25.515188 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-7e4b3d21-0c13-4b33-a630-f35b3522e519 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:02:25.521130 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7e4b3d21-0c13-4b33-a630-f35b3522e519 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:25.521609 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7e4b3d21-0c13-4b33-a630-f35b3522e519 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:25.522071 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7e4b3d21-0c13-4b33-a630-f35b3522e519 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:25.522750 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7e4b3d21-0c13-4b33-a630-f35b3522e519 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:25.523199 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7e4b3d21-0c13-4b33-a630-f35b3522e519 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:25.523620 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7e4b3d21-0c13-4b33-a630-f35b3522e519 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:25.548285 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-7e4b3d21-0c13-4b33-a630-f35b3522e519 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Going to try to terminate instance {{(pid=126813) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 20 05:02:25.622048 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-7e4b3d21-0c13-4b33-a630-f35b3522e519 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 204 len: 0 microversion: 2.20 time: 0.111074 Sep 20 05:02:25.622824 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 594/744] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Sep 20 05:02:25 2022] DELETE /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 20 05:02:25.632661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-7a0f573b-a4a5-4647-a898-ab1bff2ba71f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:02:25.633350 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-7a0f573b-a4a5-4647-a898-ab1bff2ba71f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:02:25.639512 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7a0f573b-a4a5-4647-a898-ab1bff2ba71f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:25.639986 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7a0f573b-a4a5-4647-a898-ab1bff2ba71f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:25.640412 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7a0f573b-a4a5-4647-a898-ab1bff2ba71f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:25.641114 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7a0f573b-a4a5-4647-a898-ab1bff2ba71f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:25.641562 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7a0f573b-a4a5-4647-a898-ab1bff2ba71f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:25.641981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7a0f573b-a4a5-4647-a898-ab1bff2ba71f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:25.818671 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-7a0f573b-a4a5-4647-a898-ab1bff2ba71f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:02:25.826644 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-7a0f573b-a4a5-4647-a898-ab1bff2ba71f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:02:25.828077 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-7a0f573b-a4a5-4647-a898-ab1bff2ba71f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:02:25.829255 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-7a0f573b-a4a5-4647-a898-ab1bff2ba71f tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 200 len: 1722 microversion: 2.20 time: 0.201829 Sep 20 05:02:25.829805 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 595/745] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:02:25 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 05:02:26.856595 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-e994402b-fbb6-44fb-8e22-a39167de8796 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:02:26.857339 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-e994402b-fbb6-44fb-8e22-a39167de8796 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:02:26.863590 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e994402b-fbb6-44fb-8e22-a39167de8796 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:26.864767 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e994402b-fbb6-44fb-8e22-a39167de8796 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:26.865204 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e994402b-fbb6-44fb-8e22-a39167de8796 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:26.865893 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e994402b-fbb6-44fb-8e22-a39167de8796 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:26.866345 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e994402b-fbb6-44fb-8e22-a39167de8796 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:26.866770 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e994402b-fbb6-44fb-8e22-a39167de8796 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:26.994657 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-e994402b-fbb6-44fb-8e22-a39167de8796 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:02:27.002880 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-e994402b-fbb6-44fb-8e22-a39167de8796 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:02:27.004333 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-e994402b-fbb6-44fb-8e22-a39167de8796 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:02:27.005628 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-e994402b-fbb6-44fb-8e22-a39167de8796 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 200 len: 1722 microversion: 2.20 time: 0.154101 Sep 20 05:02:27.006192 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 596/746] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:02:26 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 05:02:28.070441 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-3f0c06c6-aff1-4b35-9d46-4db06187fc80 req-ac8aebf7-89c7-411f-9a5b-bbcd780b6bc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0", "name": "network-vif-deleted", "tag": "2c6ea4a8-2bc8-407d-bc89-481d40fa0d7f"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:02:28.079958 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-3f0c06c6-aff1-4b35-9d46-4db06187fc80 req-ac8aebf7-89c7-411f-9a5b-bbcd780b6bc4 service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:28.080438 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-3f0c06c6-aff1-4b35-9d46-4db06187fc80 req-ac8aebf7-89c7-411f-9a5b-bbcd780b6bc4 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:28.080907 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-3f0c06c6-aff1-4b35-9d46-4db06187fc80 req-ac8aebf7-89c7-411f-9a5b-bbcd780b6bc4 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:28.097882 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-3f0c06c6-aff1-4b35-9d46-4db06187fc80 req-ac8aebf7-89c7-411f-9a5b-bbcd780b6bc4 service nova] Creating event network-vif-deleted:2c6ea4a8-2bc8-407d-bc89-481d40fa0d7f for instance 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 on hv-cinder-75671 Sep 20 05:02:28.104022 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-3f0c06c6-aff1-4b35-9d46-4db06187fc80 req-ac8aebf7-89c7-411f-9a5b-bbcd780b6bc4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101178 Sep 20 05:02:28.104662 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 597/747] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 05:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 05:02:28.109793 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-59780151-5e8b-4309-a86a-e2f3b1ab0f59 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:02:28.110496 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-59780151-5e8b-4309-a86a-e2f3b1ab0f59 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:02:28.117757 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-59780151-5e8b-4309-a86a-e2f3b1ab0f59 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:28.118246 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-59780151-5e8b-4309-a86a-e2f3b1ab0f59 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:28.118679 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-59780151-5e8b-4309-a86a-e2f3b1ab0f59 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:28.119375 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-59780151-5e8b-4309-a86a-e2f3b1ab0f59 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:28.119995 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-59780151-5e8b-4309-a86a-e2f3b1ab0f59 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:28.120419 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-59780151-5e8b-4309-a86a-e2f3b1ab0f59 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:28.165457 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-59780151-5e8b-4309-a86a-e2f3b1ab0f59 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:28.166033 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-59780151-5e8b-4309-a86a-e2f3b1ab0f59 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:28.166551 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-59780151-5e8b-4309-a86a-e2f3b1ab0f59 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:28.167051 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.objects.instance [None req-59780151-5e8b-4309-a86a-e2f3b1ab0f59 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lazy-loading 'fault' on Instance uuid 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 {{(pid=126813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 05:02:28.225288 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-59780151-5e8b-4309-a86a-e2f3b1ab0f59 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:02:28.237297 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-59780151-5e8b-4309-a86a-e2f3b1ab0f59 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:02:28.239898 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-59780151-5e8b-4309-a86a-e2f3b1ab0f59 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32cbf88b156745ae9a59e8f795e8ef58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56047142d69c4c1cbfa9f6a278622332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:02:28.241974 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-59780151-5e8b-4309-a86a-e2f3b1ab0f59 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 200 len: 1370 microversion: 2.20 time: 0.135811 Sep 20 05:02:28.243002 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 598/748] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:02:28 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 1370 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 05:02:29.268553 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-a96ca89b-dce8-4f8c-8f64-8098bf8b78ad tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:02:29.269290 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-a96ca89b-dce8-4f8c-8f64-8098bf8b78ad tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:02:29.276248 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a96ca89b-dce8-4f8c-8f64-8098bf8b78ad tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:29.276779 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a96ca89b-dce8-4f8c-8f64-8098bf8b78ad tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:29.277222 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a96ca89b-dce8-4f8c-8f64-8098bf8b78ad tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:29.277922 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a96ca89b-dce8-4f8c-8f64-8098bf8b78ad tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:29.278374 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a96ca89b-dce8-4f8c-8f64-8098bf8b78ad tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:29.278802 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a96ca89b-dce8-4f8c-8f64-8098bf8b78ad tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:29.292063 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.wsgi [None req-a96ca89b-dce8-4f8c-8f64-8098bf8b78ad tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] HTTP exception thrown: Instance 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 could not be found. Sep 20 05:02:29.293738 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-a96ca89b-dce8-4f8c-8f64-8098bf8b78ad tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Request method failure captured: Sep 20 05:02:29.293738 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: request: GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 HTTP/1.1 Sep 20 05:02:29.293738 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept: application/json Sep 20 05:02:29.293738 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept-Encoding: identity Sep 20 05:02:29.293738 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Connection: close Sep 20 05:02:29.293738 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Length: 0 Sep 20 05:02:29.293738 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Type: application/json Sep 20 05:02:29.293738 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Host: 10.222.0.27 Sep 20 05:02:29.293738 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Openstack-System-Scope: None Sep 20 05:02:29.293738 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: User-Agent: python-urllib3/1.26.12 Sep 20 05:02:29.293738 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Auth-Token: gAAAAABjKUhDVBHaSpNACo82MHQ488h9Hz6V238eHIgRuUiiTwfqDQF6wao0qjXI0FwBIjNyQ6oysjhAo1Odz8q7TrY8h1D3GP2ImwzuG616a9u9M6ilutBilZvjrydf0Z6X_jyetyJ5crDl6VWYL8XBjC9GHNcdNMdpo2vdAF1KJSW6LbunlUE Sep 20 05:02:29.293738 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Id: None Sep 20 05:02:29.293738 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Name: None Sep 20 05:02:29.293738 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Identity-Status: Confirmed Sep 20 05:02:29.293738 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Is-Admin-Project: True Sep 20 05:02:29.293738 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Openstack-Nova-Api-Version: 2.20 Sep 20 05:02:29.293738 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Id: default Sep 20 05:02:29.293738 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Name: Default Sep 20 05:02:29.293738 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Id: 56047142d69c4c1cbfa9f6a278622332 Sep 20 05:02:29.293738 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-104428247 Sep 20 05:02:29.293738 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Role: reader,member Sep 20 05:02:29.293738 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Roles: reader,member Sep 20 05:02:29.295487 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/56047142d69c4c1cbfa9f6a278622332"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/56047142d69c4c1cbfa9f6a278622332"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_56047142d69c4c1cbfa9f6a278622332", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/56047142d69c4c1cbfa9f6a278622332"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 05:02:29.295487 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant: tempest-AttachVolumeShelveTestJSON-104428247 Sep 20 05:02:29.295487 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Id: 56047142d69c4c1cbfa9f6a278622332 Sep 20 05:02:29.295487 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-104428247 Sep 20 05:02:29.295487 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User: tempest-AttachVolumeShelveTestJSON-104428247-project Sep 20 05:02:29.295487 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Id: default Sep 20 05:02:29.295487 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Name: Default Sep 20 05:02:29.295487 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Id: 32cbf88b156745ae9a59e8f795e8ef58 Sep 20 05:02:29.295487 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Name: tempest-AttachVolumeShelveTestJSON-104428247-project Sep 20 05:02:29.295487 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: method: > Sep 20 05:02:29.295487 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: exception: Instance 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 could not be found. Sep 20 05:02:29.295487 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: action_args: {'id': '2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0'} Sep 20 05:02:29.296442 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 05:02:29.296442 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:02:29.296442 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 05:02:29.296442 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 05:02:29.296442 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 05:02:29.296442 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 05:02:29.296442 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 05:02:29.296442 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 05:02:29.296442 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 05:02:29.296442 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 05:02:29.296442 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 could not be found. Sep 20 05:02:29.296442 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:02:29.296442 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 05:02:29.296442 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:02:29.296442 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:02:29.296442 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 05:02:29.296442 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 05:02:29.296442 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 05:02:29.296442 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 05:02:29.296442 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 05:02:29.298145 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 05:02:29.298145 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 05:02:29.298145 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 05:02:29.298145 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 05:02:29.298145 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 05:02:29.298145 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 05:02:29.298145 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 05:02:29.298145 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 could not be found. Sep 20 05:02:29.298145 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:02:29.298145 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 05:02:29.298145 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:02:29.298145 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:02:29.298145 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 05:02:29.298145 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 05:02:29.298145 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 05:02:29.298145 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 05:02:29.298145 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 could not be found. Sep 20 05:02:29.298145 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:02:29.299842 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-a96ca89b-dce8-4f8c-8f64-8098bf8b78ad tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Returning 404 to user: Instance 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 could not be found. {{(pid=126813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 05:02:29.299842 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-a96ca89b-dce8-4f8c-8f64-8098bf8b78ad tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 404 len: 111 microversion: 2.20 time: 0.030605 Sep 20 05:02:29.299842 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 599/749] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:02:29 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 20 05:02:29.303388 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-9b8dca33-ec91-450a-b170-d4802a4e150a tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '.version_select at 0x7f2e4a620c10>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:02:29.321973 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-9b8dca33-ec91-450a-b170-d4802a4e150a tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-182015166" status: 204 len: 0 microversion: 2.20 time: 0.021952 Sep 20 05:02:29.322525 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 600/750] 10.222.0.27 () {60 vars in 1259 bytes} [Tue Sep 20 05:02:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-182015166 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 20 05:02:31.050379 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-0b893c83-4567-4b4f-b199-ac7c4acc64b6 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:02:31.050963 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-0b893c83-4567-4b4f-b199-ac7c4acc64b6 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:02:31.058092 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0b893c83-4567-4b4f-b199-ac7c4acc64b6 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:31.058573 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0b893c83-4567-4b4f-b199-ac7c4acc64b6 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:31.059012 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0b893c83-4567-4b4f-b199-ac7c4acc64b6 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:31.059693 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0b893c83-4567-4b4f-b199-ac7c4acc64b6 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:31.060147 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0b893c83-4567-4b4f-b199-ac7c4acc64b6 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:31.060575 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0b893c83-4567-4b4f-b199-ac7c4acc64b6 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:31.074123 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.wsgi [None req-0b893c83-4567-4b4f-b199-ac7c4acc64b6 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] HTTP exception thrown: Instance 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 could not be found. Sep 20 05:02:31.075661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-0b893c83-4567-4b4f-b199-ac7c4acc64b6 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Request method failure captured: Sep 20 05:02:31.075661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: request: DELETE /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 HTTP/1.1 Sep 20 05:02:31.075661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept: application/json Sep 20 05:02:31.075661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept-Encoding: identity Sep 20 05:02:31.075661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Connection: close Sep 20 05:02:31.075661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Length: 0 Sep 20 05:02:31.075661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Type: application/json Sep 20 05:02:31.075661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Host: 10.222.0.27 Sep 20 05:02:31.075661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Openstack-System-Scope: None Sep 20 05:02:31.075661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: User-Agent: python-urllib3/1.26.12 Sep 20 05:02:31.075661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Auth-Token: gAAAAABjKUhDVBHaSpNACo82MHQ488h9Hz6V238eHIgRuUiiTwfqDQF6wao0qjXI0FwBIjNyQ6oysjhAo1Odz8q7TrY8h1D3GP2ImwzuG616a9u9M6ilutBilZvjrydf0Z6X_jyetyJ5crDl6VWYL8XBjC9GHNcdNMdpo2vdAF1KJSW6LbunlUE Sep 20 05:02:31.075661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Id: None Sep 20 05:02:31.075661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Name: None Sep 20 05:02:31.075661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Identity-Status: Confirmed Sep 20 05:02:31.075661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Is-Admin-Project: True Sep 20 05:02:31.075661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Openstack-Nova-Api-Version: 2.20 Sep 20 05:02:31.075661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Id: default Sep 20 05:02:31.075661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Name: Default Sep 20 05:02:31.075661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Id: 56047142d69c4c1cbfa9f6a278622332 Sep 20 05:02:31.075661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-104428247 Sep 20 05:02:31.075661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Role: reader,member Sep 20 05:02:31.075661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Roles: reader,member Sep 20 05:02:31.077412 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/56047142d69c4c1cbfa9f6a278622332"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/56047142d69c4c1cbfa9f6a278622332"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_56047142d69c4c1cbfa9f6a278622332", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/56047142d69c4c1cbfa9f6a278622332"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 05:02:31.077412 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant: tempest-AttachVolumeShelveTestJSON-104428247 Sep 20 05:02:31.077412 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Id: 56047142d69c4c1cbfa9f6a278622332 Sep 20 05:02:31.077412 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-104428247 Sep 20 05:02:31.077412 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User: tempest-AttachVolumeShelveTestJSON-104428247-project Sep 20 05:02:31.077412 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Id: default Sep 20 05:02:31.077412 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Name: Default Sep 20 05:02:31.077412 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Id: 32cbf88b156745ae9a59e8f795e8ef58 Sep 20 05:02:31.077412 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Name: tempest-AttachVolumeShelveTestJSON-104428247-project Sep 20 05:02:31.077412 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: method: > Sep 20 05:02:31.077412 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: exception: Instance 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 could not be found. Sep 20 05:02:31.077412 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: action_args: {'id': '2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0'} Sep 20 05:02:31.078215 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 05:02:31.078215 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:02:31.078215 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 05:02:31.078215 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 05:02:31.078215 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 05:02:31.078215 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 05:02:31.078215 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 05:02:31.078215 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 05:02:31.078215 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 05:02:31.078215 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 05:02:31.078215 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 could not be found. Sep 20 05:02:31.078215 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:02:31.078215 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 05:02:31.078215 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:02:31.078215 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:02:31.078215 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 05:02:31.078215 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 05:02:31.078215 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 05:02:31.078215 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 05:02:31.078215 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 05:02:31.079449 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 05:02:31.079449 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 20 05:02:31.079449 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 20 05:02:31.079449 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 20 05:02:31.079449 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 20 05:02:31.079449 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 05:02:31.079449 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 05:02:31.079449 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 05:02:31.079449 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 05:02:31.079449 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 could not be found. Sep 20 05:02:31.079449 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:02:31.079449 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 05:02:31.079449 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:02:31.079449 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:02:31.079449 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 05:02:31.079449 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 05:02:31.079449 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 05:02:31.079449 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 05:02:31.079449 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 could not be found. Sep 20 05:02:31.079449 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:02:31.080774 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-0b893c83-4567-4b4f-b199-ac7c4acc64b6 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Returning 404 to user: Instance 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 could not be found. {{(pid=126813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 05:02:31.080774 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-0b893c83-4567-4b4f-b199-ac7c4acc64b6 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 404 len: 111 microversion: 2.20 time: 0.030986 Sep 20 05:02:31.080774 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 601/751] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Sep 20 05:02:31 2022] DELETE /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 20 05:02:31.084796 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-1c27f9e9-24a1-4d85-84d7-aaa5ffbea9c1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:02:31.085395 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-1c27f9e9-24a1-4d85-84d7-aaa5ffbea9c1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:02:31.090960 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1c27f9e9-24a1-4d85-84d7-aaa5ffbea9c1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:31.091432 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1c27f9e9-24a1-4d85-84d7-aaa5ffbea9c1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:31.091864 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1c27f9e9-24a1-4d85-84d7-aaa5ffbea9c1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:31.092536 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1c27f9e9-24a1-4d85-84d7-aaa5ffbea9c1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:31.093013 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1c27f9e9-24a1-4d85-84d7-aaa5ffbea9c1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:31.093437 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1c27f9e9-24a1-4d85-84d7-aaa5ffbea9c1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:31.106322 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.wsgi [None req-1c27f9e9-24a1-4d85-84d7-aaa5ffbea9c1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] HTTP exception thrown: Instance 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 could not be found. Sep 20 05:02:31.107817 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-1c27f9e9-24a1-4d85-84d7-aaa5ffbea9c1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Request method failure captured: Sep 20 05:02:31.107817 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: request: GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 HTTP/1.1 Sep 20 05:02:31.107817 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept: application/json Sep 20 05:02:31.107817 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept-Encoding: identity Sep 20 05:02:31.107817 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Connection: close Sep 20 05:02:31.107817 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Length: 0 Sep 20 05:02:31.107817 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Type: application/json Sep 20 05:02:31.107817 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Host: 10.222.0.27 Sep 20 05:02:31.107817 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Openstack-System-Scope: None Sep 20 05:02:31.107817 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: User-Agent: python-urllib3/1.26.12 Sep 20 05:02:31.107817 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Auth-Token: gAAAAABjKUhDVBHaSpNACo82MHQ488h9Hz6V238eHIgRuUiiTwfqDQF6wao0qjXI0FwBIjNyQ6oysjhAo1Odz8q7TrY8h1D3GP2ImwzuG616a9u9M6ilutBilZvjrydf0Z6X_jyetyJ5crDl6VWYL8XBjC9GHNcdNMdpo2vdAF1KJSW6LbunlUE Sep 20 05:02:31.107817 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Id: None Sep 20 05:02:31.107817 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Name: None Sep 20 05:02:31.107817 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Identity-Status: Confirmed Sep 20 05:02:31.107817 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Is-Admin-Project: True Sep 20 05:02:31.107817 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Openstack-Nova-Api-Version: 2.20 Sep 20 05:02:31.107817 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Id: default Sep 20 05:02:31.107817 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Name: Default Sep 20 05:02:31.107817 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Id: 56047142d69c4c1cbfa9f6a278622332 Sep 20 05:02:31.107817 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-104428247 Sep 20 05:02:31.107817 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Role: reader,member Sep 20 05:02:31.107817 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Roles: reader,member Sep 20 05:02:31.109520 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/56047142d69c4c1cbfa9f6a278622332"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/56047142d69c4c1cbfa9f6a278622332"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_56047142d69c4c1cbfa9f6a278622332", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/56047142d69c4c1cbfa9f6a278622332"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 05:02:31.109520 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant: tempest-AttachVolumeShelveTestJSON-104428247 Sep 20 05:02:31.109520 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Id: 56047142d69c4c1cbfa9f6a278622332 Sep 20 05:02:31.109520 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-104428247 Sep 20 05:02:31.109520 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User: tempest-AttachVolumeShelveTestJSON-104428247-project Sep 20 05:02:31.109520 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Id: default Sep 20 05:02:31.109520 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Name: Default Sep 20 05:02:31.109520 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Id: 32cbf88b156745ae9a59e8f795e8ef58 Sep 20 05:02:31.109520 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Name: tempest-AttachVolumeShelveTestJSON-104428247-project Sep 20 05:02:31.109520 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: method: > Sep 20 05:02:31.109520 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: exception: Instance 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 could not be found. Sep 20 05:02:31.109520 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: action_args: {'id': '2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0'} Sep 20 05:02:31.110550 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 05:02:31.110550 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:02:31.110550 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 05:02:31.110550 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 05:02:31.110550 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 05:02:31.110550 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 05:02:31.110550 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 05:02:31.110550 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 05:02:31.110550 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 05:02:31.110550 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 05:02:31.110550 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 could not be found. Sep 20 05:02:31.110550 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:02:31.110550 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 05:02:31.110550 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:02:31.110550 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:02:31.110550 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 05:02:31.110550 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 05:02:31.110550 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 05:02:31.110550 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 05:02:31.110550 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 05:02:31.111980 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 05:02:31.111980 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 05:02:31.111980 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 05:02:31.111980 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 05:02:31.111980 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 05:02:31.111980 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 05:02:31.111980 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 05:02:31.111980 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 could not be found. Sep 20 05:02:31.111980 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:02:31.111980 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 05:02:31.111980 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:02:31.111980 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:02:31.111980 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 05:02:31.111980 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 05:02:31.111980 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 05:02:31.111980 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 05:02:31.111980 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 could not be found. Sep 20 05:02:31.111980 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:02:31.113374 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-1c27f9e9-24a1-4d85-84d7-aaa5ffbea9c1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Returning 404 to user: Instance 2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 could not be found. {{(pid=126813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 05:02:31.113374 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-1c27f9e9-24a1-4d85-84d7-aaa5ffbea9c1 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0" status: 404 len: 111 microversion: 2.20 time: 0.027795 Sep 20 05:02:31.113374 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 602/752] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:02:31 2022] GET /compute/v2.1/servers/2dfecf9d-adc1-4ba4-93d3-3105c57b9ca0 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 20 05:02:32.246512 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-ac2d6778-2c5f-448c-aa39-fb9e10575961 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:02:32.247099 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-ac2d6778-2c5f-448c-aa39-fb9e10575961 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:02:32.253365 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ac2d6778-2c5f-448c-aa39-fb9e10575961 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:32.253847 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ac2d6778-2c5f-448c-aa39-fb9e10575961 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:32.254278 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ac2d6778-2c5f-448c-aa39-fb9e10575961 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:32.255449 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ac2d6778-2c5f-448c-aa39-fb9e10575961 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:32.255946 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ac2d6778-2c5f-448c-aa39-fb9e10575961 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:32.256370 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ac2d6778-2c5f-448c-aa39-fb9e10575961 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:32.270671 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.wsgi [None req-ac2d6778-2c5f-448c-aa39-fb9e10575961 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] HTTP exception thrown: Instance 1dc0a271-e3e8-4883-b052-72a5c319c6b7 could not be found. Sep 20 05:02:32.272211 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-ac2d6778-2c5f-448c-aa39-fb9e10575961 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Request method failure captured: Sep 20 05:02:32.272211 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: request: DELETE /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 HTTP/1.1 Sep 20 05:02:32.272211 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept: application/json Sep 20 05:02:32.272211 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept-Encoding: identity Sep 20 05:02:32.272211 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Connection: close Sep 20 05:02:32.272211 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Length: 0 Sep 20 05:02:32.272211 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Type: application/json Sep 20 05:02:32.272211 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Host: 10.222.0.27 Sep 20 05:02:32.272211 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Openstack-System-Scope: None Sep 20 05:02:32.272211 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: User-Agent: python-urllib3/1.26.12 Sep 20 05:02:32.272211 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Auth-Token: gAAAAABjKUhDVBHaSpNACo82MHQ488h9Hz6V238eHIgRuUiiTwfqDQF6wao0qjXI0FwBIjNyQ6oysjhAo1Odz8q7TrY8h1D3GP2ImwzuG616a9u9M6ilutBilZvjrydf0Z6X_jyetyJ5crDl6VWYL8XBjC9GHNcdNMdpo2vdAF1KJSW6LbunlUE Sep 20 05:02:32.272211 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Id: None Sep 20 05:02:32.272211 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Name: None Sep 20 05:02:32.272211 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Identity-Status: Confirmed Sep 20 05:02:32.272211 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Is-Admin-Project: True Sep 20 05:02:32.272211 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Openstack-Nova-Api-Version: 2.20 Sep 20 05:02:32.272211 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Id: default Sep 20 05:02:32.272211 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Name: Default Sep 20 05:02:32.272211 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Id: 56047142d69c4c1cbfa9f6a278622332 Sep 20 05:02:32.272211 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-104428247 Sep 20 05:02:32.272211 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Role: reader,member Sep 20 05:02:32.272211 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Roles: reader,member Sep 20 05:02:32.273920 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/56047142d69c4c1cbfa9f6a278622332"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/56047142d69c4c1cbfa9f6a278622332"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_56047142d69c4c1cbfa9f6a278622332", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/56047142d69c4c1cbfa9f6a278622332"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 05:02:32.273920 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant: tempest-AttachVolumeShelveTestJSON-104428247 Sep 20 05:02:32.273920 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Id: 56047142d69c4c1cbfa9f6a278622332 Sep 20 05:02:32.273920 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-104428247 Sep 20 05:02:32.273920 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User: tempest-AttachVolumeShelveTestJSON-104428247-project Sep 20 05:02:32.273920 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Id: default Sep 20 05:02:32.273920 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Name: Default Sep 20 05:02:32.273920 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Id: 32cbf88b156745ae9a59e8f795e8ef58 Sep 20 05:02:32.273920 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Name: tempest-AttachVolumeShelveTestJSON-104428247-project Sep 20 05:02:32.273920 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: method: > Sep 20 05:02:32.273920 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: exception: Instance 1dc0a271-e3e8-4883-b052-72a5c319c6b7 could not be found. Sep 20 05:02:32.273920 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: action_args: {'id': '1dc0a271-e3e8-4883-b052-72a5c319c6b7'} Sep 20 05:02:32.274825 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 05:02:32.274825 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:02:32.274825 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 05:02:32.274825 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 05:02:32.274825 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 05:02:32.274825 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 05:02:32.274825 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 05:02:32.274825 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 05:02:32.274825 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 05:02:32.274825 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 05:02:32.274825 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1dc0a271-e3e8-4883-b052-72a5c319c6b7 could not be found. Sep 20 05:02:32.274825 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:02:32.274825 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 05:02:32.274825 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:02:32.274825 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:02:32.274825 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 05:02:32.274825 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 05:02:32.274825 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 05:02:32.274825 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 05:02:32.274825 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 05:02:32.276351 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 05:02:32.276351 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 20 05:02:32.276351 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 20 05:02:32.276351 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 20 05:02:32.276351 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 20 05:02:32.276351 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 05:02:32.276351 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 05:02:32.276351 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 05:02:32.276351 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 05:02:32.276351 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dc0a271-e3e8-4883-b052-72a5c319c6b7 could not be found. Sep 20 05:02:32.276351 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:02:32.276351 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 05:02:32.276351 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:02:32.276351 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:02:32.276351 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 05:02:32.276351 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 05:02:32.276351 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 05:02:32.276351 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 05:02:32.276351 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dc0a271-e3e8-4883-b052-72a5c319c6b7 could not be found. Sep 20 05:02:32.276351 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:02:32.277867 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-ac2d6778-2c5f-448c-aa39-fb9e10575961 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Returning 404 to user: Instance 1dc0a271-e3e8-4883-b052-72a5c319c6b7 could not be found. {{(pid=126813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 05:02:32.277867 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-ac2d6778-2c5f-448c-aa39-fb9e10575961 tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 404 len: 111 microversion: 2.20 time: 0.030899 Sep 20 05:02:32.277867 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 603/753] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Sep 20 05:02:32 2022] DELETE /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 20 05:02:32.281686 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-05987d86-bbfb-4c3e-82a6-2cb01cb0277b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:02:32.282222 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-05987d86-bbfb-4c3e-82a6-2cb01cb0277b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] [instance: 1dc0a271-e3e8-4883-b052-72a5c319c6b7] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:02:32.287743 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-05987d86-bbfb-4c3e-82a6-2cb01cb0277b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:32.288216 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-05987d86-bbfb-4c3e-82a6-2cb01cb0277b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:32.288669 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-05987d86-bbfb-4c3e-82a6-2cb01cb0277b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:32.289340 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-05987d86-bbfb-4c3e-82a6-2cb01cb0277b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:32.289783 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-05987d86-bbfb-4c3e-82a6-2cb01cb0277b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:32.290202 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-05987d86-bbfb-4c3e-82a6-2cb01cb0277b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:32.303105 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.wsgi [None req-05987d86-bbfb-4c3e-82a6-2cb01cb0277b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] HTTP exception thrown: Instance 1dc0a271-e3e8-4883-b052-72a5c319c6b7 could not be found. Sep 20 05:02:32.304581 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-05987d86-bbfb-4c3e-82a6-2cb01cb0277b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Request method failure captured: Sep 20 05:02:32.304581 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: request: GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 HTTP/1.1 Sep 20 05:02:32.304581 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept: application/json Sep 20 05:02:32.304581 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept-Encoding: identity Sep 20 05:02:32.304581 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Connection: close Sep 20 05:02:32.304581 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Length: 0 Sep 20 05:02:32.304581 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Type: application/json Sep 20 05:02:32.304581 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Host: 10.222.0.27 Sep 20 05:02:32.304581 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Openstack-System-Scope: None Sep 20 05:02:32.304581 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: User-Agent: python-urllib3/1.26.12 Sep 20 05:02:32.304581 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Auth-Token: gAAAAABjKUhDVBHaSpNACo82MHQ488h9Hz6V238eHIgRuUiiTwfqDQF6wao0qjXI0FwBIjNyQ6oysjhAo1Odz8q7TrY8h1D3GP2ImwzuG616a9u9M6ilutBilZvjrydf0Z6X_jyetyJ5crDl6VWYL8XBjC9GHNcdNMdpo2vdAF1KJSW6LbunlUE Sep 20 05:02:32.304581 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Id: None Sep 20 05:02:32.304581 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Name: None Sep 20 05:02:32.304581 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Identity-Status: Confirmed Sep 20 05:02:32.304581 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Is-Admin-Project: True Sep 20 05:02:32.304581 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Openstack-Nova-Api-Version: 2.20 Sep 20 05:02:32.304581 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Id: default Sep 20 05:02:32.304581 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Name: Default Sep 20 05:02:32.304581 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Id: 56047142d69c4c1cbfa9f6a278622332 Sep 20 05:02:32.304581 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-104428247 Sep 20 05:02:32.304581 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Role: reader,member Sep 20 05:02:32.304581 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Roles: reader,member Sep 20 05:02:32.306308 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/56047142d69c4c1cbfa9f6a278622332"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/56047142d69c4c1cbfa9f6a278622332"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_56047142d69c4c1cbfa9f6a278622332", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/56047142d69c4c1cbfa9f6a278622332"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 05:02:32.306308 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant: tempest-AttachVolumeShelveTestJSON-104428247 Sep 20 05:02:32.306308 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Id: 56047142d69c4c1cbfa9f6a278622332 Sep 20 05:02:32.306308 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-104428247 Sep 20 05:02:32.306308 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User: tempest-AttachVolumeShelveTestJSON-104428247-project Sep 20 05:02:32.306308 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Id: default Sep 20 05:02:32.306308 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Name: Default Sep 20 05:02:32.306308 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Id: 32cbf88b156745ae9a59e8f795e8ef58 Sep 20 05:02:32.306308 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Name: tempest-AttachVolumeShelveTestJSON-104428247-project Sep 20 05:02:32.306308 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: method: > Sep 20 05:02:32.306308 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: exception: Instance 1dc0a271-e3e8-4883-b052-72a5c319c6b7 could not be found. Sep 20 05:02:32.306308 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: action_args: {'id': '1dc0a271-e3e8-4883-b052-72a5c319c6b7'} Sep 20 05:02:32.307275 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 05:02:32.307275 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:02:32.307275 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 05:02:32.307275 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 05:02:32.307275 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 05:02:32.307275 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 05:02:32.307275 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 05:02:32.307275 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 05:02:32.307275 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 05:02:32.307275 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 05:02:32.307275 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1dc0a271-e3e8-4883-b052-72a5c319c6b7 could not be found. Sep 20 05:02:32.307275 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:02:32.307275 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 05:02:32.307275 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:02:32.307275 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:02:32.307275 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 05:02:32.307275 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 05:02:32.307275 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 05:02:32.307275 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 05:02:32.307275 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 05:02:32.308876 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 05:02:32.308876 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 05:02:32.308876 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 05:02:32.308876 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 05:02:32.308876 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 05:02:32.308876 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 05:02:32.308876 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 05:02:32.308876 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dc0a271-e3e8-4883-b052-72a5c319c6b7 could not be found. Sep 20 05:02:32.308876 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:02:32.308876 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 05:02:32.308876 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:02:32.308876 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:02:32.308876 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 05:02:32.308876 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 05:02:32.308876 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 05:02:32.308876 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 05:02:32.308876 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dc0a271-e3e8-4883-b052-72a5c319c6b7 could not be found. Sep 20 05:02:32.308876 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:02:32.310284 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-05987d86-bbfb-4c3e-82a6-2cb01cb0277b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] Returning 404 to user: Instance 1dc0a271-e3e8-4883-b052-72a5c319c6b7 could not be found. {{(pid=126813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 05:02:32.310284 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-05987d86-bbfb-4c3e-82a6-2cb01cb0277b tempest-AttachVolumeShelveTestJSON-104428247 tempest-AttachVolumeShelveTestJSON-104428247-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7" status: 404 len: 111 microversion: 2.20 time: 0.027814 Sep 20 05:02:32.310284 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 604/754] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Sep 20 05:02:32 2022] GET /compute/v2.1/servers/1dc0a271-e3e8-4883-b052-72a5c319c6b7 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 20 05:02:33.560521 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-8626535d-1204-4d85-8bfa-839e14475855 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:02:33.561195 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-8626535d-1204-4d85-8bfa-839e14475855 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: 7d0a9581-09a0-4287-ac5a-260cbfd04a98] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:02:33.568645 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8626535d-1204-4d85-8bfa-839e14475855 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:33.569233 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8626535d-1204-4d85-8bfa-839e14475855 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:33.569740 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8626535d-1204-4d85-8bfa-839e14475855 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:33.570548 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8626535d-1204-4d85-8bfa-839e14475855 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:33.571085 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8626535d-1204-4d85-8bfa-839e14475855 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:33.571580 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8626535d-1204-4d85-8bfa-839e14475855 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:33.601116 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-8626535d-1204-4d85-8bfa-839e14475855 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: 7d0a9581-09a0-4287-ac5a-260cbfd04a98] Going to try to terminate instance {{(pid=126813) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 20 05:02:33.689454 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-8626535d-1204-4d85-8bfa-839e14475855 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7d0a9581-09a0-4287-ac5a-260cbfd04a98" status: 204 len: 0 microversion: 2.1 time: 0.132351 Sep 20 05:02:33.690739 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 605/755] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Sep 20 05:02:33 2022] DELETE /compute/v2.1/servers/7d0a9581-09a0-4287-ac5a-260cbfd04a98 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 20 05:02:33.696977 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-805d3c53-b03c-4e91-ac26-3b2c1a9f8594 req-11469835-8bd8-46be-94af-69afdcebc6fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d0a9581-09a0-4287-ac5a-260cbfd04a98", "tag": "8a48051c-d8ba-4a69-917d-d7daa79bcd01"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:02:33.707297 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-805d3c53-b03c-4e91-ac26-3b2c1a9f8594 req-11469835-8bd8-46be-94af-69afdcebc6fa service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:33.708772 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-805d3c53-b03c-4e91-ac26-3b2c1a9f8594 req-11469835-8bd8-46be-94af-69afdcebc6fa service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:33.709398 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-805d3c53-b03c-4e91-ac26-3b2c1a9f8594 req-11469835-8bd8-46be-94af-69afdcebc6fa service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:33.721856 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-805d3c53-b03c-4e91-ac26-3b2c1a9f8594 req-11469835-8bd8-46be-94af-69afdcebc6fa service nova] Creating event network-changed:8a48051c-d8ba-4a69-917d-d7daa79bcd01 for instance 7d0a9581-09a0-4287-ac5a-260cbfd04a98 on hv-cinder-75671 Sep 20 05:02:33.728022 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-805d3c53-b03c-4e91-ac26-3b2c1a9f8594 req-11469835-8bd8-46be-94af-69afdcebc6fa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035753 Sep 20 05:02:33.728999 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 606/756] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 05:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 05:02:33.738166 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-721f2091-d207-40fa-9b54-b9b97de68db7 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:02:33.738905 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-721f2091-d207-40fa-9b54-b9b97de68db7 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: 7d0a9581-09a0-4287-ac5a-260cbfd04a98] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:02:33.745570 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-721f2091-d207-40fa-9b54-b9b97de68db7 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:33.745971 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-721f2091-d207-40fa-9b54-b9b97de68db7 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:33.746448 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-721f2091-d207-40fa-9b54-b9b97de68db7 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:33.747275 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-721f2091-d207-40fa-9b54-b9b97de68db7 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:33.747744 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-721f2091-d207-40fa-9b54-b9b97de68db7 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:33.749100 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-721f2091-d207-40fa-9b54-b9b97de68db7 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:33.973893 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-721f2091-d207-40fa-9b54-b9b97de68db7 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:02:33.982992 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-721f2091-d207-40fa-9b54-b9b97de68db7 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/7d0a9581-09a0-4287-ac5a-260cbfd04a98" status: 200 len: 1575 microversion: 2.1 time: 0.249044 Sep 20 05:02:33.983780 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 607/757] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:02:33 2022] GET /compute/v2.1/servers/7d0a9581-09a0-4287-ac5a-260cbfd04a98 => generated 1575 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 05:02:35.010875 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-d768e2e8-114f-4e6a-a2de-146a9a37ae22 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:02:35.011774 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-d768e2e8-114f-4e6a-a2de-146a9a37ae22 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: 7d0a9581-09a0-4287-ac5a-260cbfd04a98] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:02:35.023087 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d768e2e8-114f-4e6a-a2de-146a9a37ae22 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:35.023578 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d768e2e8-114f-4e6a-a2de-146a9a37ae22 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:35.024017 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d768e2e8-114f-4e6a-a2de-146a9a37ae22 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:35.024747 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d768e2e8-114f-4e6a-a2de-146a9a37ae22 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:35.025203 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d768e2e8-114f-4e6a-a2de-146a9a37ae22 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:35.025627 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d768e2e8-114f-4e6a-a2de-146a9a37ae22 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:35.163265 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-d768e2e8-114f-4e6a-a2de-146a9a37ae22 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:02:35.171349 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-d768e2e8-114f-4e6a-a2de-146a9a37ae22 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/7d0a9581-09a0-4287-ac5a-260cbfd04a98" status: 200 len: 1575 microversion: 2.1 time: 0.164843 Sep 20 05:02:35.172003 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 608/758] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:02:35 2022] GET /compute/v2.1/servers/7d0a9581-09a0-4287-ac5a-260cbfd04a98 => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:02:36.196977 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-4cead86b-d659-4a1d-ba1d-ff2009be81e6 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:02:36.196977 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-4cead86b-d659-4a1d-ba1d-ff2009be81e6 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: 7d0a9581-09a0-4287-ac5a-260cbfd04a98] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:02:36.208454 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4cead86b-d659-4a1d-ba1d-ff2009be81e6 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:36.209003 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4cead86b-d659-4a1d-ba1d-ff2009be81e6 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:36.209444 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4cead86b-d659-4a1d-ba1d-ff2009be81e6 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:36.210151 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4cead86b-d659-4a1d-ba1d-ff2009be81e6 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:36.210603 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4cead86b-d659-4a1d-ba1d-ff2009be81e6 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:36.211035 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4cead86b-d659-4a1d-ba1d-ff2009be81e6 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:36.307526 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-4cead86b-d659-4a1d-ba1d-ff2009be81e6 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:02:36.315996 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-4cead86b-d659-4a1d-ba1d-ff2009be81e6 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/7d0a9581-09a0-4287-ac5a-260cbfd04a98" status: 200 len: 1391 microversion: 2.1 time: 0.124453 Sep 20 05:02:36.316702 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 609/759] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:02:36 2022] GET /compute/v2.1/servers/7d0a9581-09a0-4287-ac5a-260cbfd04a98 => generated 1391 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:02:36.397946 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-7f2cbeff-35ed-4bc0-b898-47af7dc2f48b req-731a8a85-0425-4de3-85cb-7fc9c07d8612 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d0a9581-09a0-4287-ac5a-260cbfd04a98", "name": "network-vif-deleted", "tag": "8a48051c-d8ba-4a69-917d-d7daa79bcd01"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:02:36.407201 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-7f2cbeff-35ed-4bc0-b898-47af7dc2f48b req-731a8a85-0425-4de3-85cb-7fc9c07d8612 service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:36.407673 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-7f2cbeff-35ed-4bc0-b898-47af7dc2f48b req-731a8a85-0425-4de3-85cb-7fc9c07d8612 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:36.408098 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-7f2cbeff-35ed-4bc0-b898-47af7dc2f48b req-731a8a85-0425-4de3-85cb-7fc9c07d8612 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:36.419328 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-7f2cbeff-35ed-4bc0-b898-47af7dc2f48b req-731a8a85-0425-4de3-85cb-7fc9c07d8612 service nova] Creating event network-vif-deleted:8a48051c-d8ba-4a69-917d-d7daa79bcd01 for instance 7d0a9581-09a0-4287-ac5a-260cbfd04a98 on hv-cinder-75671 Sep 20 05:02:36.424377 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-7f2cbeff-35ed-4bc0-b898-47af7dc2f48b req-731a8a85-0425-4de3-85cb-7fc9c07d8612 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093931 Sep 20 05:02:36.425164 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 610/760] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 05:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 05:02:37.343605 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-f715b069-5a64-4aed-9cf8-4017f43f2d54 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:02:37.344409 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-f715b069-5a64-4aed-9cf8-4017f43f2d54 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: 7d0a9581-09a0-4287-ac5a-260cbfd04a98] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:02:37.351024 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f715b069-5a64-4aed-9cf8-4017f43f2d54 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:37.351507 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f715b069-5a64-4aed-9cf8-4017f43f2d54 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:37.351942 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f715b069-5a64-4aed-9cf8-4017f43f2d54 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:37.352648 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f715b069-5a64-4aed-9cf8-4017f43f2d54 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:37.353099 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f715b069-5a64-4aed-9cf8-4017f43f2d54 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:37.353519 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f715b069-5a64-4aed-9cf8-4017f43f2d54 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:37.366880 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.wsgi [None req-f715b069-5a64-4aed-9cf8-4017f43f2d54 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] HTTP exception thrown: Instance 7d0a9581-09a0-4287-ac5a-260cbfd04a98 could not be found. Sep 20 05:02:37.368484 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-f715b069-5a64-4aed-9cf8-4017f43f2d54 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Request method failure captured: Sep 20 05:02:37.368484 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: request: GET /compute/v2.1/servers/7d0a9581-09a0-4287-ac5a-260cbfd04a98 HTTP/1.1 Sep 20 05:02:37.368484 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept: application/json Sep 20 05:02:37.368484 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept-Encoding: identity Sep 20 05:02:37.368484 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Connection: close Sep 20 05:02:37.368484 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Length: 0 Sep 20 05:02:37.368484 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Type: application/json Sep 20 05:02:37.368484 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Host: 10.222.0.27 Sep 20 05:02:37.368484 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Openstack-System-Scope: None Sep 20 05:02:37.368484 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: User-Agent: python-urllib3/1.26.12 Sep 20 05:02:37.368484 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Auth-Token: gAAAAABjKUfZVi2qjLqig0kK97c4DzE9yfobdafEkYrJ8uuLLci8Rz68vTzMuy-88mPU5lLRfY0UarUF0zVZuvtDO57qpqNazu2dNfa5mipjreQeWKMB1OTvXMsITFeAqBT73vXFkoJpxd6T7RNIw5Fh6jeMxd6M1thpIdxRJbBBnEA7X2xYE1k Sep 20 05:02:37.368484 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Id: None Sep 20 05:02:37.368484 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Name: None Sep 20 05:02:37.368484 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Identity-Status: Confirmed Sep 20 05:02:37.368484 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Is-Admin-Project: True Sep 20 05:02:37.368484 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Id: default Sep 20 05:02:37.368484 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Name: Default Sep 20 05:02:37.368484 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Id: 46ddf925b345471da94d05998a6a0540 Sep 20 05:02:37.368484 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Name: tempest-TestVolumeBootPattern-728794636 Sep 20 05:02:37.368484 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Role: reader,member Sep 20 05:02:37.368484 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Roles: reader,member Sep 20 05:02:37.370193 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/46ddf925b345471da94d05998a6a0540"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/46ddf925b345471da94d05998a6a0540"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_46ddf925b345471da94d05998a6a0540", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/46ddf925b345471da94d05998a6a0540"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 05:02:37.370193 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant: tempest-TestVolumeBootPattern-728794636 Sep 20 05:02:37.370193 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Id: 46ddf925b345471da94d05998a6a0540 Sep 20 05:02:37.370193 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Name: tempest-TestVolumeBootPattern-728794636 Sep 20 05:02:37.370193 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User: tempest-TestVolumeBootPattern-728794636-project Sep 20 05:02:37.370193 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Id: default Sep 20 05:02:37.370193 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Name: Default Sep 20 05:02:37.370193 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Id: 946a0fd33f754ce1aa534ab88dc95aa9 Sep 20 05:02:37.370193 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Name: tempest-TestVolumeBootPattern-728794636-project Sep 20 05:02:37.370193 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: method: > Sep 20 05:02:37.370193 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: exception: Instance 7d0a9581-09a0-4287-ac5a-260cbfd04a98 could not be found. Sep 20 05:02:37.370193 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: action_args: {'id': '7d0a9581-09a0-4287-ac5a-260cbfd04a98'} Sep 20 05:02:37.371103 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 05:02:37.371103 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:02:37.371103 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 05:02:37.371103 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 05:02:37.371103 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 05:02:37.371103 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 05:02:37.371103 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 05:02:37.371103 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 05:02:37.371103 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 05:02:37.371103 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 05:02:37.371103 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d0a9581-09a0-4287-ac5a-260cbfd04a98 could not be found. Sep 20 05:02:37.371103 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:02:37.371103 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 05:02:37.371103 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:02:37.371103 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:02:37.371103 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 05:02:37.371103 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 05:02:37.371103 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 05:02:37.371103 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 05:02:37.371103 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 05:02:37.372651 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 05:02:37.372651 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 05:02:37.372651 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 05:02:37.372651 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 05:02:37.372651 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 05:02:37.372651 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 05:02:37.372651 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 05:02:37.372651 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d0a9581-09a0-4287-ac5a-260cbfd04a98 could not be found. Sep 20 05:02:37.372651 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:02:37.372651 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 05:02:37.372651 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:02:37.372651 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:02:37.372651 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 05:02:37.372651 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 05:02:37.372651 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 05:02:37.372651 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 05:02:37.372651 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d0a9581-09a0-4287-ac5a-260cbfd04a98 could not be found. Sep 20 05:02:37.372651 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:02:37.374038 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-f715b069-5a64-4aed-9cf8-4017f43f2d54 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Returning 404 to user: Instance 7d0a9581-09a0-4287-ac5a-260cbfd04a98 could not be found. {{(pid=126813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 05:02:37.374038 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-f715b069-5a64-4aed-9cf8-4017f43f2d54 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/7d0a9581-09a0-4287-ac5a-260cbfd04a98" status: 404 len: 111 microversion: 2.1 time: 0.030422 Sep 20 05:02:37.374038 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 611/761] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:02:37 2022] GET /compute/v2.1/servers/7d0a9581-09a0-4287-ac5a-260cbfd04a98 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 20 05:02:40.635563 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-21b46969-855c-4fea-8851-736a2d676f8a tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:02:40.637144 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-21b46969-855c-4fea-8851-736a2d676f8a tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: cd514882-49cd-4d14-a8e1-b17b0605cd1f] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:02:40.646625 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-21b46969-855c-4fea-8851-736a2d676f8a tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:40.647703 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-21b46969-855c-4fea-8851-736a2d676f8a tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:40.648718 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-21b46969-855c-4fea-8851-736a2d676f8a tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:40.650911 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-21b46969-855c-4fea-8851-736a2d676f8a tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:40.652109 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-21b46969-855c-4fea-8851-736a2d676f8a tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:40.653362 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-21b46969-855c-4fea-8851-736a2d676f8a tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:40.688275 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-21b46969-855c-4fea-8851-736a2d676f8a tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: cd514882-49cd-4d14-a8e1-b17b0605cd1f] Going to try to terminate instance {{(pid=126813) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 20 05:02:40.692337 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:40.798734 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-21b46969-855c-4fea-8851-736a2d676f8a tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cd514882-49cd-4d14-a8e1-b17b0605cd1f" status: 204 len: 0 microversion: 2.1 time: 0.167208 Sep 20 05:02:40.802943 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 612/762] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Sep 20 05:02:40 2022] DELETE /compute/v2.1/servers/cd514882-49cd-4d14-a8e1-b17b0605cd1f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 20 05:02:40.813790 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-00209c6c-5ccb-4395-8265-bcf9699924cc req-60505f28-1b13-4707-8d68-3a7171e08864 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd514882-49cd-4d14-a8e1-b17b0605cd1f", "tag": "cdc3a8f8-3815-44e2-8784-9ad2e03e2914"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:02:40.830830 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-00209c6c-5ccb-4395-8265-bcf9699924cc req-60505f28-1b13-4707-8d68-3a7171e08864 service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:40.831491 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-00209c6c-5ccb-4395-8265-bcf9699924cc req-60505f28-1b13-4707-8d68-3a7171e08864 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:40.833243 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-00209c6c-5ccb-4395-8265-bcf9699924cc req-60505f28-1b13-4707-8d68-3a7171e08864 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:40.846549 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-00209c6c-5ccb-4395-8265-bcf9699924cc req-60505f28-1b13-4707-8d68-3a7171e08864 service nova] Creating event network-changed:cdc3a8f8-3815-44e2-8784-9ad2e03e2914 for instance cd514882-49cd-4d14-a8e1-b17b0605cd1f on hv-cinder-75671 Sep 20 05:02:40.852580 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-00209c6c-5ccb-4395-8265-bcf9699924cc req-60505f28-1b13-4707-8d68-3a7171e08864 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042874 Sep 20 05:02:40.853543 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 613/763] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 05:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 05:02:40.859758 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-755871fa-788d-4316-b326-7c304e225e21 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:02:40.860644 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-755871fa-788d-4316-b326-7c304e225e21 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: cd514882-49cd-4d14-a8e1-b17b0605cd1f] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:02:40.869060 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-755871fa-788d-4316-b326-7c304e225e21 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:40.869584 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-755871fa-788d-4316-b326-7c304e225e21 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:40.870034 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-755871fa-788d-4316-b326-7c304e225e21 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:40.870846 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-755871fa-788d-4316-b326-7c304e225e21 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:40.871324 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-755871fa-788d-4316-b326-7c304e225e21 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:40.871978 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-755871fa-788d-4316-b326-7c304e225e21 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:41.179174 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-755871fa-788d-4316-b326-7c304e225e21 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:02:41.193484 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-755871fa-788d-4316-b326-7c304e225e21 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/cd514882-49cd-4d14-a8e1-b17b0605cd1f" status: 200 len: 1578 microversion: 2.1 time: 0.338590 Sep 20 05:02:41.194791 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 614/764] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:02:40 2022] GET /compute/v2.1/servers/cd514882-49cd-4d14-a8e1-b17b0605cd1f => generated 1578 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 05:02:42.019647 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-9a81ef5c-4727-4a85-8c06-1af6f5aedd25 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Action: 'create', calling method: .version_select at 0x7f2e4a4d8790>, body: {"keypair": {"name": "tempest-keypair-361722205", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNTQ+oLnxtEQ0ZQ5McEdURWRQej+B30Khw7ZSkRwMxbW4CBuVTUO2yAdjcK/v1M2fkEhs3bd2TNBm8dHZ9OekiS4Qwmh9n7TkCpmhWw0rTIwc1a7JkEk3pklM0m4xSo9iA=="}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:02:42.037092 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-9a81ef5c-4727-4a85-8c06-1af6f5aedd25 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Getting quotas for project 3218048072f048d9afc65ae138523bfd. Resources: {'key_pairs'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 05:02:42.041733 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-9a81ef5c-4727-4a85-8c06-1af6f5aedd25 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Getting quotas for user 1947f5ce1d794f05ae6272e8dba5d29c and project 3218048072f048d9afc65ae138523bfd. Resources: {'key_pairs'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 05:02:42.070603 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-9a81ef5c-4727-4a85-8c06-1af6f5aedd25 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.189828 Sep 20 05:02:42.071204 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 615/765] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Sep 20 05:02:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 05:02:42.219236 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-dfde6091-1572-4c7b-a4d4-90a2c6c00965 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:02:42.220247 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-dfde6091-1572-4c7b-a4d4-90a2c6c00965 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: cd514882-49cd-4d14-a8e1-b17b0605cd1f] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:02:42.236882 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-dfde6091-1572-4c7b-a4d4-90a2c6c00965 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:42.237704 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-dfde6091-1572-4c7b-a4d4-90a2c6c00965 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:42.238457 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-dfde6091-1572-4c7b-a4d4-90a2c6c00965 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:42.239456 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-dfde6091-1572-4c7b-a4d4-90a2c6c00965 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:42.239914 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-dfde6091-1572-4c7b-a4d4-90a2c6c00965 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:42.240335 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-dfde6091-1572-4c7b-a4d4-90a2c6c00965 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:42.510388 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-dfde6091-1572-4c7b-a4d4-90a2c6c00965 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:02:42.518725 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-dfde6091-1572-4c7b-a4d4-90a2c6c00965 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/cd514882-49cd-4d14-a8e1-b17b0605cd1f" status: 200 len: 1578 microversion: 2.1 time: 0.303921 Sep 20 05:02:42.524657 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 616/766] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:02:42 2022] GET /compute/v2.1/servers/cd514882-49cd-4d14-a8e1-b17b0605cd1f => generated 1578 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 05:02:43.294899 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-5b9c5aea-6071-4366-8e9e-7c160286d823 req-53b9cff9-d07d-4129-b0ef-d1df83052369 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd514882-49cd-4d14-a8e1-b17b0605cd1f", "name": "network-vif-deleted", "tag": "cdc3a8f8-3815-44e2-8784-9ad2e03e2914"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:02:43.307850 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-5b9c5aea-6071-4366-8e9e-7c160286d823 req-53b9cff9-d07d-4129-b0ef-d1df83052369 service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:43.308331 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-5b9c5aea-6071-4366-8e9e-7c160286d823 req-53b9cff9-d07d-4129-b0ef-d1df83052369 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:43.308811 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-5b9c5aea-6071-4366-8e9e-7c160286d823 req-53b9cff9-d07d-4129-b0ef-d1df83052369 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:43.322398 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-5b9c5aea-6071-4366-8e9e-7c160286d823 req-53b9cff9-d07d-4129-b0ef-d1df83052369 service nova] Creating event network-vif-deleted:cdc3a8f8-3815-44e2-8784-9ad2e03e2914 for instance cd514882-49cd-4d14-a8e1-b17b0605cd1f on hv-cinder-75671 Sep 20 05:02:43.327528 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-5b9c5aea-6071-4366-8e9e-7c160286d823 req-53b9cff9-d07d-4129-b0ef-d1df83052369 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036238 Sep 20 05:02:43.328422 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 617/767] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 05:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 05:02:43.544212 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-01b8c298-5c88-45c2-91d3-a8e8f135de17 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:02:43.544973 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-01b8c298-5c88-45c2-91d3-a8e8f135de17 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: cd514882-49cd-4d14-a8e1-b17b0605cd1f] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:02:43.559472 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-01b8c298-5c88-45c2-91d3-a8e8f135de17 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:43.561775 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-01b8c298-5c88-45c2-91d3-a8e8f135de17 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:43.562557 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-01b8c298-5c88-45c2-91d3-a8e8f135de17 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:43.563484 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-01b8c298-5c88-45c2-91d3-a8e8f135de17 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:43.564172 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-01b8c298-5c88-45c2-91d3-a8e8f135de17 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:43.564852 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-01b8c298-5c88-45c2-91d3-a8e8f135de17 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:43.644783 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-01b8c298-5c88-45c2-91d3-a8e8f135de17 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946a0fd33f754ce1aa534ab88dc95aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ddf925b345471da94d05998a6a0540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:02:43.654973 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-01b8c298-5c88-45c2-91d3-a8e8f135de17 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/cd514882-49cd-4d14-a8e1-b17b0605cd1f" status: 200 len: 1225 microversion: 2.1 time: 0.115065 Sep 20 05:02:43.655676 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 618/768] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:02:43 2022] GET /compute/v2.1/servers/cd514882-49cd-4d14-a8e1-b17b0605cd1f => generated 1225 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:02:44.137819 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-c9d8f219-ef02-4b04-b3f8-ce29cb17e3de tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-833110029", "imageRef": "080ea053-830e-4470-a886-0ab99b0ab3e0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "447d3db5-30f6-43d8-9751-379a0d9ed4d0"}], "security_groups": [{"name": "tempest-securitygroup--1012305076"}], "key_name": "tempest-keypair-361722205", "user_data": "}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:02:44.264311 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.network.neutron [None req-c9d8f219-ef02-4b04-b3f8-ce29cb17e3de tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] validate_networks() for [('447d3db5-30f6-43d8-9751-379a0d9ed4d0', None, None, None, None, None)] {{(pid=126813) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 20 05:02:44.712787 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-c9d8f219-ef02-4b04-b3f8-ce29cb17e3de tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Flavor limits 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 20 05:02:44.713288 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-c9d8f219-ef02-4b04-b3f8-ce29cb17e3de tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Image limits 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 20 05:02:44.713771 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-c9d8f219-ef02-4b04-b3f8-ce29cb17e3de tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Flavor pref 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 20 05:02:44.714176 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-c9d8f219-ef02-4b04-b3f8-ce29cb17e3de tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Image pref 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 20 05:02:44.714580 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-c9d8f219-ef02-4b04-b3f8-ce29cb17e3de tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 20 05:02:44.723476 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c9d8f219-ef02-4b04-b3f8-ce29cb17e3de tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:44.724126 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c9d8f219-ef02-4b04-b3f8-ce29cb17e3de tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:44.724564 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c9d8f219-ef02-4b04-b3f8-ce29cb17e3de tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:44.725314 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c9d8f219-ef02-4b04-b3f8-ce29cb17e3de tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:44.725790 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c9d8f219-ef02-4b04-b3f8-ce29cb17e3de tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:44.726216 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c9d8f219-ef02-4b04-b3f8-ce29cb17e3de tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:44.743207 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-c9d8f219-ef02-4b04-b3f8-ce29cb17e3de tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Getting quotas for project 3218048072f048d9afc65ae138523bfd. Resources: {'ram', 'cores', 'instances'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 05:02:44.747243 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-c9d8f219-ef02-4b04-b3f8-ce29cb17e3de tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Getting quotas for user 1947f5ce1d794f05ae6272e8dba5d29c and project 3218048072f048d9afc65ae138523bfd. Resources: {'ram', 'cores', 'instances'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 05:02:44.758825 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-c9d8f219-ef02-4b04-b3f8-ce29cb17e3de tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Going to run 1 instances... {{(pid=126813) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 20 05:02:44.761146 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-c9d8f219-ef02-4b04-b3f8-ce29cb17e3de tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 6a85f27c-bdfe-4580-8579-71ea2b71bbfd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='080ea053-830e-4470-a886-0ab99b0ab3e0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126813) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 20 05:02:44.772824 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=2 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:44.809583 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-c9d8f219-ef02-4b04-b3f8-ce29cb17e3de tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.676464 Sep 20 05:02:44.810205 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 619/769] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Sep 20 05:02:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 20 05:02:44.814910 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-27afe56f-7b10-4eaa-967b-ceb00ebdde06 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:02:44.815510 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-27afe56f-7b10-4eaa-967b-ceb00ebdde06 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: cd514882-49cd-4d14-a8e1-b17b0605cd1f] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:02:44.822492 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-27afe56f-7b10-4eaa-967b-ceb00ebdde06 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:44.823224 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-27afe56f-7b10-4eaa-967b-ceb00ebdde06 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:44.823655 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-27afe56f-7b10-4eaa-967b-ceb00ebdde06 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:44.824345 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-27afe56f-7b10-4eaa-967b-ceb00ebdde06 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:44.824973 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-27afe56f-7b10-4eaa-967b-ceb00ebdde06 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:44.825551 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-27afe56f-7b10-4eaa-967b-ceb00ebdde06 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:44.852501 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.wsgi [None req-27afe56f-7b10-4eaa-967b-ceb00ebdde06 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] HTTP exception thrown: Instance cd514882-49cd-4d14-a8e1-b17b0605cd1f could not be found. Sep 20 05:02:44.854227 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-27afe56f-7b10-4eaa-967b-ceb00ebdde06 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Request method failure captured: Sep 20 05:02:44.854227 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: request: GET /compute/v2.1/servers/cd514882-49cd-4d14-a8e1-b17b0605cd1f HTTP/1.1 Sep 20 05:02:44.854227 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept: application/json Sep 20 05:02:44.854227 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept-Encoding: identity Sep 20 05:02:44.854227 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Connection: close Sep 20 05:02:44.854227 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Length: 0 Sep 20 05:02:44.854227 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Type: application/json Sep 20 05:02:44.854227 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Host: 10.222.0.27 Sep 20 05:02:44.854227 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Openstack-System-Scope: None Sep 20 05:02:44.854227 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: User-Agent: python-urllib3/1.26.12 Sep 20 05:02:44.854227 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Auth-Token: gAAAAABjKUfZVi2qjLqig0kK97c4DzE9yfobdafEkYrJ8uuLLci8Rz68vTzMuy-88mPU5lLRfY0UarUF0zVZuvtDO57qpqNazu2dNfa5mipjreQeWKMB1OTvXMsITFeAqBT73vXFkoJpxd6T7RNIw5Fh6jeMxd6M1thpIdxRJbBBnEA7X2xYE1k Sep 20 05:02:44.854227 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Id: None Sep 20 05:02:44.854227 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Name: None Sep 20 05:02:44.854227 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Identity-Status: Confirmed Sep 20 05:02:44.854227 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Is-Admin-Project: True Sep 20 05:02:44.854227 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Id: default Sep 20 05:02:44.854227 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Name: Default Sep 20 05:02:44.854227 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Id: 46ddf925b345471da94d05998a6a0540 Sep 20 05:02:44.854227 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Name: tempest-TestVolumeBootPattern-728794636 Sep 20 05:02:44.854227 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Role: reader,member Sep 20 05:02:44.854227 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Roles: reader,member Sep 20 05:02:44.855864 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/46ddf925b345471da94d05998a6a0540"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/46ddf925b345471da94d05998a6a0540"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_46ddf925b345471da94d05998a6a0540", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/46ddf925b345471da94d05998a6a0540"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 05:02:44.855864 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant: tempest-TestVolumeBootPattern-728794636 Sep 20 05:02:44.855864 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Id: 46ddf925b345471da94d05998a6a0540 Sep 20 05:02:44.855864 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Name: tempest-TestVolumeBootPattern-728794636 Sep 20 05:02:44.855864 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User: tempest-TestVolumeBootPattern-728794636-project Sep 20 05:02:44.855864 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Id: default Sep 20 05:02:44.855864 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Name: Default Sep 20 05:02:44.855864 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Id: 946a0fd33f754ce1aa534ab88dc95aa9 Sep 20 05:02:44.855864 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Name: tempest-TestVolumeBootPattern-728794636-project Sep 20 05:02:44.855864 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: method: > Sep 20 05:02:44.855864 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: exception: Instance cd514882-49cd-4d14-a8e1-b17b0605cd1f could not be found. Sep 20 05:02:44.855864 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: action_args: {'id': 'cd514882-49cd-4d14-a8e1-b17b0605cd1f'} Sep 20 05:02:44.857072 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 05:02:44.857072 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:02:44.857072 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 05:02:44.857072 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 05:02:44.857072 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 05:02:44.857072 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 05:02:44.857072 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 05:02:44.857072 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 05:02:44.857072 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 05:02:44.857072 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 05:02:44.857072 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd514882-49cd-4d14-a8e1-b17b0605cd1f could not be found. Sep 20 05:02:44.857072 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:02:44.857072 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 05:02:44.857072 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:02:44.857072 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:02:44.857072 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 05:02:44.857072 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 05:02:44.857072 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 05:02:44.857072 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 05:02:44.857072 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 05:02:44.858677 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 05:02:44.858677 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 05:02:44.858677 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 05:02:44.858677 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 05:02:44.858677 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 05:02:44.858677 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 05:02:44.858677 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 05:02:44.858677 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd514882-49cd-4d14-a8e1-b17b0605cd1f could not be found. Sep 20 05:02:44.858677 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:02:44.858677 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 05:02:44.858677 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:02:44.858677 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:02:44.858677 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 05:02:44.858677 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 05:02:44.858677 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 05:02:44.858677 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 05:02:44.858677 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd514882-49cd-4d14-a8e1-b17b0605cd1f could not be found. Sep 20 05:02:44.858677 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:02:44.862197 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-27afe56f-7b10-4eaa-967b-ceb00ebdde06 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Returning 404 to user: Instance cd514882-49cd-4d14-a8e1-b17b0605cd1f could not be found. {{(pid=126813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 05:02:44.863087 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-27afe56f-7b10-4eaa-967b-ceb00ebdde06 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/cd514882-49cd-4d14-a8e1-b17b0605cd1f" status: 404 len: 111 microversion: 2.1 time: 0.051966 Sep 20 05:02:44.863646 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 620/770] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:02:44 2022] GET /compute/v2.1/servers/cd514882-49cd-4d14-a8e1-b17b0605cd1f => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 20 05:02:44.871353 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-cad035ec-dbdb-4738-aa4e-855dc0b426ca tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:02:44.875648 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-cad035ec-dbdb-4738-aa4e-855dc0b426ca tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 6a85f27c-bdfe-4580-8579-71ea2b71bbfd] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:02:44.943228 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-cad035ec-dbdb-4738-aa4e-855dc0b426ca tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1947f5ce1d794f05ae6272e8dba5d29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3218048072f048d9afc65ae138523bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:02:44.953149 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-cad035ec-dbdb-4738-aa4e-855dc0b426ca tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd" status: 200 len: 1236 microversion: 2.1 time: 0.086577 Sep 20 05:02:44.954318 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 621/771] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:02:44 2022] GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd => generated 1236 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 05:02:45.394149 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-5915906d-c1ce-4bee-8513-2971d045bf77 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:02:45.394659 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-5915906d-c1ce-4bee-8513-2971d045bf77 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: 417f5e13-88b2-4fc7-b79a-fe70372ed20d] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:02:45.403995 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5915906d-c1ce-4bee-8513-2971d045bf77 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:45.404777 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5915906d-c1ce-4bee-8513-2971d045bf77 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:45.405462 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5915906d-c1ce-4bee-8513-2971d045bf77 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:45.406456 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5915906d-c1ce-4bee-8513-2971d045bf77 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:45.406918 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5915906d-c1ce-4bee-8513-2971d045bf77 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:45.407352 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5915906d-c1ce-4bee-8513-2971d045bf77 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:45.422307 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.wsgi [None req-5915906d-c1ce-4bee-8513-2971d045bf77 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] HTTP exception thrown: Instance 417f5e13-88b2-4fc7-b79a-fe70372ed20d could not be found. Sep 20 05:02:45.424183 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-5915906d-c1ce-4bee-8513-2971d045bf77 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Request method failure captured: Sep 20 05:02:45.424183 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: request: DELETE /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d HTTP/1.1 Sep 20 05:02:45.424183 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept: application/json Sep 20 05:02:45.424183 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept-Encoding: identity Sep 20 05:02:45.424183 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Connection: close Sep 20 05:02:45.424183 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Length: 0 Sep 20 05:02:45.424183 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Type: application/json Sep 20 05:02:45.424183 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Host: 10.222.0.27 Sep 20 05:02:45.424183 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Openstack-System-Scope: None Sep 20 05:02:45.424183 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: User-Agent: python-urllib3/1.26.12 Sep 20 05:02:45.424183 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Auth-Token: gAAAAABjKUfZVi2qjLqig0kK97c4DzE9yfobdafEkYrJ8uuLLci8Rz68vTzMuy-88mPU5lLRfY0UarUF0zVZuvtDO57qpqNazu2dNfa5mipjreQeWKMB1OTvXMsITFeAqBT73vXFkoJpxd6T7RNIw5Fh6jeMxd6M1thpIdxRJbBBnEA7X2xYE1k Sep 20 05:02:45.424183 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Id: None Sep 20 05:02:45.424183 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Name: None Sep 20 05:02:45.424183 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Identity-Status: Confirmed Sep 20 05:02:45.424183 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Is-Admin-Project: True Sep 20 05:02:45.424183 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Id: default Sep 20 05:02:45.424183 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Name: Default Sep 20 05:02:45.424183 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Id: 46ddf925b345471da94d05998a6a0540 Sep 20 05:02:45.424183 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Name: tempest-TestVolumeBootPattern-728794636 Sep 20 05:02:45.424183 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Role: reader,member Sep 20 05:02:45.424183 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Roles: reader,member Sep 20 05:02:45.425944 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/46ddf925b345471da94d05998a6a0540"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/46ddf925b345471da94d05998a6a0540"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_46ddf925b345471da94d05998a6a0540", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/46ddf925b345471da94d05998a6a0540"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 05:02:45.425944 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant: tempest-TestVolumeBootPattern-728794636 Sep 20 05:02:45.425944 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Id: 46ddf925b345471da94d05998a6a0540 Sep 20 05:02:45.425944 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Name: tempest-TestVolumeBootPattern-728794636 Sep 20 05:02:45.425944 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User: tempest-TestVolumeBootPattern-728794636-project Sep 20 05:02:45.425944 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Id: default Sep 20 05:02:45.425944 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Name: Default Sep 20 05:02:45.425944 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Id: 946a0fd33f754ce1aa534ab88dc95aa9 Sep 20 05:02:45.425944 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Name: tempest-TestVolumeBootPattern-728794636-project Sep 20 05:02:45.425944 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: method: > Sep 20 05:02:45.425944 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: exception: Instance 417f5e13-88b2-4fc7-b79a-fe70372ed20d could not be found. Sep 20 05:02:45.425944 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: action_args: {'id': '417f5e13-88b2-4fc7-b79a-fe70372ed20d'} Sep 20 05:02:45.426941 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 05:02:45.426941 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:02:45.426941 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 05:02:45.426941 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 05:02:45.426941 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 05:02:45.426941 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 05:02:45.426941 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 05:02:45.426941 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 05:02:45.426941 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 05:02:45.426941 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 05:02:45.426941 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 417f5e13-88b2-4fc7-b79a-fe70372ed20d could not be found. Sep 20 05:02:45.426941 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:02:45.426941 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 05:02:45.426941 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:02:45.426941 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:02:45.426941 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 05:02:45.426941 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 05:02:45.426941 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 05:02:45.426941 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 05:02:45.426941 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 05:02:45.428487 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 05:02:45.428487 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 20 05:02:45.428487 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 20 05:02:45.428487 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 20 05:02:45.428487 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 20 05:02:45.428487 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 05:02:45.428487 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 05:02:45.428487 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 05:02:45.428487 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 05:02:45.428487 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 417f5e13-88b2-4fc7-b79a-fe70372ed20d could not be found. Sep 20 05:02:45.428487 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:02:45.428487 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 05:02:45.428487 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:02:45.428487 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:02:45.428487 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 05:02:45.428487 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 05:02:45.428487 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 05:02:45.428487 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 05:02:45.428487 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 417f5e13-88b2-4fc7-b79a-fe70372ed20d could not be found. Sep 20 05:02:45.428487 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:02:45.430891 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-5915906d-c1ce-4bee-8513-2971d045bf77 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Returning 404 to user: Instance 417f5e13-88b2-4fc7-b79a-fe70372ed20d could not be found. {{(pid=126813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 05:02:45.432017 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-5915906d-c1ce-4bee-8513-2971d045bf77 tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "DELETE /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d" status: 404 len: 111 microversion: 2.1 time: 0.043086 Sep 20 05:02:45.432772 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 622/772] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Sep 20 05:02:45 2022] DELETE /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 20 05:02:45.445041 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-24570d3f-e334-4292-b96a-29066f40b80f tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:02:45.445664 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-24570d3f-e334-4292-b96a-29066f40b80f tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] [instance: 417f5e13-88b2-4fc7-b79a-fe70372ed20d] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:02:45.451659 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-24570d3f-e334-4292-b96a-29066f40b80f tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:45.452152 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-24570d3f-e334-4292-b96a-29066f40b80f tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:45.452589 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-24570d3f-e334-4292-b96a-29066f40b80f tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:45.453516 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-24570d3f-e334-4292-b96a-29066f40b80f tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:45.454126 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-24570d3f-e334-4292-b96a-29066f40b80f tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:45.454718 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-24570d3f-e334-4292-b96a-29066f40b80f tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:45.472201 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.wsgi [None req-24570d3f-e334-4292-b96a-29066f40b80f tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] HTTP exception thrown: Instance 417f5e13-88b2-4fc7-b79a-fe70372ed20d could not be found. Sep 20 05:02:45.474366 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-24570d3f-e334-4292-b96a-29066f40b80f tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Request method failure captured: Sep 20 05:02:45.474366 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: request: GET /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d HTTP/1.1 Sep 20 05:02:45.474366 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept: application/json Sep 20 05:02:45.474366 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept-Encoding: identity Sep 20 05:02:45.474366 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Connection: close Sep 20 05:02:45.474366 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Length: 0 Sep 20 05:02:45.474366 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Type: application/json Sep 20 05:02:45.474366 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Host: 10.222.0.27 Sep 20 05:02:45.474366 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Openstack-System-Scope: None Sep 20 05:02:45.474366 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: User-Agent: python-urllib3/1.26.12 Sep 20 05:02:45.474366 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Auth-Token: gAAAAABjKUfZVi2qjLqig0kK97c4DzE9yfobdafEkYrJ8uuLLci8Rz68vTzMuy-88mPU5lLRfY0UarUF0zVZuvtDO57qpqNazu2dNfa5mipjreQeWKMB1OTvXMsITFeAqBT73vXFkoJpxd6T7RNIw5Fh6jeMxd6M1thpIdxRJbBBnEA7X2xYE1k Sep 20 05:02:45.474366 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Id: None Sep 20 05:02:45.474366 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Name: None Sep 20 05:02:45.474366 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Identity-Status: Confirmed Sep 20 05:02:45.474366 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Is-Admin-Project: True Sep 20 05:02:45.474366 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Id: default Sep 20 05:02:45.474366 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Name: Default Sep 20 05:02:45.474366 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Id: 46ddf925b345471da94d05998a6a0540 Sep 20 05:02:45.474366 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Name: tempest-TestVolumeBootPattern-728794636 Sep 20 05:02:45.474366 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Role: reader,member Sep 20 05:02:45.474366 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Roles: reader,member Sep 20 05:02:45.475818 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/46ddf925b345471da94d05998a6a0540"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/46ddf925b345471da94d05998a6a0540"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_46ddf925b345471da94d05998a6a0540", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/46ddf925b345471da94d05998a6a0540"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 05:02:45.475818 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant: tempest-TestVolumeBootPattern-728794636 Sep 20 05:02:45.475818 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Id: 46ddf925b345471da94d05998a6a0540 Sep 20 05:02:45.475818 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Name: tempest-TestVolumeBootPattern-728794636 Sep 20 05:02:45.475818 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User: tempest-TestVolumeBootPattern-728794636-project Sep 20 05:02:45.475818 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Id: default Sep 20 05:02:45.475818 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Name: Default Sep 20 05:02:45.475818 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Id: 946a0fd33f754ce1aa534ab88dc95aa9 Sep 20 05:02:45.475818 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Name: tempest-TestVolumeBootPattern-728794636-project Sep 20 05:02:45.475818 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: method: > Sep 20 05:02:45.475818 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: exception: Instance 417f5e13-88b2-4fc7-b79a-fe70372ed20d could not be found. Sep 20 05:02:45.475818 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: action_args: {'id': '417f5e13-88b2-4fc7-b79a-fe70372ed20d'} Sep 20 05:02:45.476755 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 05:02:45.476755 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:02:45.476755 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 05:02:45.476755 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 05:02:45.476755 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 05:02:45.476755 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 05:02:45.476755 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 05:02:45.476755 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 05:02:45.476755 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 05:02:45.476755 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 05:02:45.476755 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 417f5e13-88b2-4fc7-b79a-fe70372ed20d could not be found. Sep 20 05:02:45.476755 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:02:45.476755 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 05:02:45.476755 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:02:45.476755 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:02:45.476755 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 05:02:45.476755 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 05:02:45.476755 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 05:02:45.476755 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 05:02:45.476755 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 05:02:45.478685 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 05:02:45.478685 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 05:02:45.478685 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 05:02:45.478685 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 05:02:45.478685 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 05:02:45.478685 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 05:02:45.478685 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 05:02:45.478685 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 417f5e13-88b2-4fc7-b79a-fe70372ed20d could not be found. Sep 20 05:02:45.478685 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:02:45.478685 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 05:02:45.478685 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:02:45.478685 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:02:45.478685 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 05:02:45.478685 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 05:02:45.478685 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 05:02:45.478685 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 05:02:45.478685 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 417f5e13-88b2-4fc7-b79a-fe70372ed20d could not be found. Sep 20 05:02:45.478685 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:02:45.481316 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-24570d3f-e334-4292-b96a-29066f40b80f tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Returning 404 to user: Instance 417f5e13-88b2-4fc7-b79a-fe70372ed20d could not be found. {{(pid=126813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 05:02:45.481316 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-24570d3f-e334-4292-b96a-29066f40b80f tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "GET /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d" status: 404 len: 111 microversion: 2.1 time: 0.034802 Sep 20 05:02:45.481316 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 623/773] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:02:45 2022] GET /compute/v2.1/servers/417f5e13-88b2-4fc7-b79a-fe70372ed20d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 20 05:02:45.975554 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-7e398139-1f07-4622-8367-8c1b4595019c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:02:45.976188 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-7e398139-1f07-4622-8367-8c1b4595019c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 6a85f27c-bdfe-4580-8579-71ea2b71bbfd] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:02:45.983044 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7e398139-1f07-4622-8367-8c1b4595019c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:45.983540 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7e398139-1f07-4622-8367-8c1b4595019c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:45.984014 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7e398139-1f07-4622-8367-8c1b4595019c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:45.984988 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7e398139-1f07-4622-8367-8c1b4595019c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:45.985450 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7e398139-1f07-4622-8367-8c1b4595019c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:45.985881 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7e398139-1f07-4622-8367-8c1b4595019c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:46.052072 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-7e398139-1f07-4622-8367-8c1b4595019c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1947f5ce1d794f05ae6272e8dba5d29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3218048072f048d9afc65ae138523bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:02:46.060022 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-7e398139-1f07-4622-8367-8c1b4595019c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd" status: 200 len: 1288 microversion: 2.1 time: 0.088496 Sep 20 05:02:46.060577 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 624/774] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:02:45 2022] GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd => generated 1288 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:02:46.794047 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-318682f8-0c54-45da-adc3-7b83e6a86f8f tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] Calling method '.version_select at 0x7f2e4a8861f0>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:02:46.813994 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-318682f8-0c54-45da-adc3-7b83e6a86f8f tempest-TestVolumeBootPattern-728794636 tempest-TestVolumeBootPattern-728794636-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-140645421" status: 202 len: 0 microversion: 2.1 time: 0.024451 Sep 20 05:02:46.818824 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 625/775] 10.222.0.27 () {58 vars in 1260 bytes} [Tue Sep 20 05:02:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-140645421 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 20 05:02:47.084184 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-3ee1802f-45da-48bd-9db3-cf084fab729c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:02:47.085768 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-3ee1802f-45da-48bd-9db3-cf084fab729c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 6a85f27c-bdfe-4580-8579-71ea2b71bbfd] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:02:47.098587 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3ee1802f-45da-48bd-9db3-cf084fab729c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:47.099287 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3ee1802f-45da-48bd-9db3-cf084fab729c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:47.099888 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3ee1802f-45da-48bd-9db3-cf084fab729c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:47.100824 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3ee1802f-45da-48bd-9db3-cf084fab729c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:47.101434 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3ee1802f-45da-48bd-9db3-cf084fab729c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:47.102027 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3ee1802f-45da-48bd-9db3-cf084fab729c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:47.327344 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-3ee1802f-45da-48bd-9db3-cf084fab729c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1947f5ce1d794f05ae6272e8dba5d29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3218048072f048d9afc65ae138523bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:02:47.335526 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-3ee1802f-45da-48bd-9db3-cf084fab729c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd" status: 200 len: 1362 microversion: 2.1 time: 0.256043 Sep 20 05:02:47.336093 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 626/776] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:02:47 2022] GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd => generated 1362 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:02:47.684131 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-e871d9d3-0a75-48a7-8a08-fbb35c15ce8b req-48f7c69f-5c2e-476b-ac2c-b6857f89d7fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a85f27c-bdfe-4580-8579-71ea2b71bbfd", "tag": "f15fb1a3-73e1-48d8-b0d4-41cf678fb197"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:02:47.694861 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-e871d9d3-0a75-48a7-8a08-fbb35c15ce8b req-48f7c69f-5c2e-476b-ac2c-b6857f89d7fb service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:47.695662 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-e871d9d3-0a75-48a7-8a08-fbb35c15ce8b req-48f7c69f-5c2e-476b-ac2c-b6857f89d7fb service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:47.696287 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-e871d9d3-0a75-48a7-8a08-fbb35c15ce8b req-48f7c69f-5c2e-476b-ac2c-b6857f89d7fb service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:47.708371 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-e871d9d3-0a75-48a7-8a08-fbb35c15ce8b req-48f7c69f-5c2e-476b-ac2c-b6857f89d7fb service nova] Creating event network-changed:f15fb1a3-73e1-48d8-b0d4-41cf678fb197 for instance 6a85f27c-bdfe-4580-8579-71ea2b71bbfd on hv-cinder-75671 Sep 20 05:02:47.713452 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-e871d9d3-0a75-48a7-8a08-fbb35c15ce8b req-48f7c69f-5c2e-476b-ac2c-b6857f89d7fb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033042 Sep 20 05:02:47.714273 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 627/777] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 05:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 05:02:48.360118 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-7728ec48-ce36-4a63-a231-e4dbe2a63b71 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:02:48.360874 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-7728ec48-ce36-4a63-a231-e4dbe2a63b71 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 6a85f27c-bdfe-4580-8579-71ea2b71bbfd] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:02:48.367523 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7728ec48-ce36-4a63-a231-e4dbe2a63b71 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:48.368009 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7728ec48-ce36-4a63-a231-e4dbe2a63b71 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:48.368502 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7728ec48-ce36-4a63-a231-e4dbe2a63b71 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:48.369253 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7728ec48-ce36-4a63-a231-e4dbe2a63b71 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:48.369702 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7728ec48-ce36-4a63-a231-e4dbe2a63b71 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:48.370128 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7728ec48-ce36-4a63-a231-e4dbe2a63b71 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:48.648377 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-7728ec48-ce36-4a63-a231-e4dbe2a63b71 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1947f5ce1d794f05ae6272e8dba5d29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3218048072f048d9afc65ae138523bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:02:48.656311 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-7728ec48-ce36-4a63-a231-e4dbe2a63b71 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd" status: 200 len: 1362 microversion: 2.1 time: 0.300974 Sep 20 05:02:48.656911 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 628/778] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:02:48 2022] GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd => generated 1362 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:02:49.678929 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-50e94dfa-3e07-4648-9b0e-bf3e3f0bf5c3 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:02:49.679809 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-50e94dfa-3e07-4648-9b0e-bf3e3f0bf5c3 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 6a85f27c-bdfe-4580-8579-71ea2b71bbfd] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:02:49.687598 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-50e94dfa-3e07-4648-9b0e-bf3e3f0bf5c3 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:49.688503 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-50e94dfa-3e07-4648-9b0e-bf3e3f0bf5c3 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:49.688961 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-50e94dfa-3e07-4648-9b0e-bf3e3f0bf5c3 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:49.689793 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-50e94dfa-3e07-4648-9b0e-bf3e3f0bf5c3 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:49.690909 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-50e94dfa-3e07-4648-9b0e-bf3e3f0bf5c3 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:49.691339 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-50e94dfa-3e07-4648-9b0e-bf3e3f0bf5c3 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:49.863979 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-50e94dfa-3e07-4648-9b0e-bf3e3f0bf5c3 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1947f5ce1d794f05ae6272e8dba5d29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3218048072f048d9afc65ae138523bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:02:49.874516 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-50e94dfa-3e07-4648-9b0e-bf3e3f0bf5c3 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd" status: 200 len: 1362 microversion: 2.1 time: 0.199416 Sep 20 05:02:49.893206 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 629/779] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:02:49 2022] GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd => generated 1362 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 05:02:50.900570 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-da45d81f-c3e4-413c-ba75-d755a5a515b8 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:02:50.901360 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-da45d81f-c3e4-413c-ba75-d755a5a515b8 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 6a85f27c-bdfe-4580-8579-71ea2b71bbfd] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:02:50.907880 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-da45d81f-c3e4-413c-ba75-d755a5a515b8 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:50.908364 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-da45d81f-c3e4-413c-ba75-d755a5a515b8 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:50.908839 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-da45d81f-c3e4-413c-ba75-d755a5a515b8 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:50.909529 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-da45d81f-c3e4-413c-ba75-d755a5a515b8 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:50.909978 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-da45d81f-c3e4-413c-ba75-d755a5a515b8 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:50.910396 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-da45d81f-c3e4-413c-ba75-d755a5a515b8 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:51.119926 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-da45d81f-c3e4-413c-ba75-d755a5a515b8 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1947f5ce1d794f05ae6272e8dba5d29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3218048072f048d9afc65ae138523bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:02:51.127664 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-da45d81f-c3e4-413c-ba75-d755a5a515b8 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd" status: 200 len: 1362 microversion: 2.1 time: 0.230993 Sep 20 05:02:51.128448 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 630/780] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:02:50 2022] GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd => generated 1362 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:02:51.814457 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-32037988-92fb-49c2-9e20-fedcf0de81c6 req-1b361a19-5725-4092-948b-57ca19c517e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a85f27c-bdfe-4580-8579-71ea2b71bbfd", "name": "network-vif-plugged", "status": "completed", "tag": "f15fb1a3-73e1-48d8-b0d4-41cf678fb197"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:02:51.831011 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-32037988-92fb-49c2-9e20-fedcf0de81c6 req-1b361a19-5725-4092-948b-57ca19c517e3 service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:51.831527 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-32037988-92fb-49c2-9e20-fedcf0de81c6 req-1b361a19-5725-4092-948b-57ca19c517e3 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:51.831977 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-32037988-92fb-49c2-9e20-fedcf0de81c6 req-1b361a19-5725-4092-948b-57ca19c517e3 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:51.851757 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-32037988-92fb-49c2-9e20-fedcf0de81c6 req-1b361a19-5725-4092-948b-57ca19c517e3 service nova] Creating event network-vif-plugged:f15fb1a3-73e1-48d8-b0d4-41cf678fb197 for instance 6a85f27c-bdfe-4580-8579-71ea2b71bbfd on hv-cinder-75671 Sep 20 05:02:51.857758 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-32037988-92fb-49c2-9e20-fedcf0de81c6 req-1b361a19-5725-4092-948b-57ca19c517e3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114575 Sep 20 05:02:51.858740 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 631/781] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 05:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 05:02:52.151253 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-e8eb2654-b406-4553-bb27-965acd125794 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:02:52.152802 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-e8eb2654-b406-4553-bb27-965acd125794 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 6a85f27c-bdfe-4580-8579-71ea2b71bbfd] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:02:52.160925 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e8eb2654-b406-4553-bb27-965acd125794 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:52.162056 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e8eb2654-b406-4553-bb27-965acd125794 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:52.162813 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e8eb2654-b406-4553-bb27-965acd125794 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:52.163994 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e8eb2654-b406-4553-bb27-965acd125794 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:52.164642 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e8eb2654-b406-4553-bb27-965acd125794 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:52.165390 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e8eb2654-b406-4553-bb27-965acd125794 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:52.368731 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-e8eb2654-b406-4553-bb27-965acd125794 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1947f5ce1d794f05ae6272e8dba5d29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3218048072f048d9afc65ae138523bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:02:52.377177 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-e8eb2654-b406-4553-bb27-965acd125794 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd" status: 200 len: 1362 microversion: 2.1 time: 0.230940 Sep 20 05:02:52.377949 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 632/782] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:02:52 2022] GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd => generated 1362 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:02:53.401372 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-6671ecc3-8982-4844-9248-4777c7d227b9 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:02:53.402102 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-6671ecc3-8982-4844-9248-4777c7d227b9 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 6a85f27c-bdfe-4580-8579-71ea2b71bbfd] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:02:53.408724 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6671ecc3-8982-4844-9248-4777c7d227b9 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:53.409213 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6671ecc3-8982-4844-9248-4777c7d227b9 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:53.409652 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6671ecc3-8982-4844-9248-4777c7d227b9 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:53.410386 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6671ecc3-8982-4844-9248-4777c7d227b9 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:53.410839 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6671ecc3-8982-4844-9248-4777c7d227b9 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:53.411263 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6671ecc3-8982-4844-9248-4777c7d227b9 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:53.646409 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-6671ecc3-8982-4844-9248-4777c7d227b9 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1947f5ce1d794f05ae6272e8dba5d29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3218048072f048d9afc65ae138523bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:02:53.655055 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-6671ecc3-8982-4844-9248-4777c7d227b9 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd" status: 200 len: 1362 microversion: 2.1 time: 0.257448 Sep 20 05:02:53.655714 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 633/783] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:02:53 2022] GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd => generated 1362 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:02:54.678986 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-1355269f-4cf5-4f97-a218-258c032a8285 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:02:54.679605 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-1355269f-4cf5-4f97-a218-258c032a8285 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 6a85f27c-bdfe-4580-8579-71ea2b71bbfd] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:02:54.686183 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1355269f-4cf5-4f97-a218-258c032a8285 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:54.686672 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1355269f-4cf5-4f97-a218-258c032a8285 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:54.687114 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1355269f-4cf5-4f97-a218-258c032a8285 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:54.687819 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1355269f-4cf5-4f97-a218-258c032a8285 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:54.688275 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1355269f-4cf5-4f97-a218-258c032a8285 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:54.688783 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1355269f-4cf5-4f97-a218-258c032a8285 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:54.734429 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell0:SELECT=2 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:54.833309 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-1355269f-4cf5-4f97-a218-258c032a8285 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1947f5ce1d794f05ae6272e8dba5d29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3218048072f048d9afc65ae138523bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:02:54.842251 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-1355269f-4cf5-4f97-a218-258c032a8285 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd" status: 200 len: 1548 microversion: 2.1 time: 0.167786 Sep 20 05:02:54.843512 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 634/784] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:02:54 2022] GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd => generated 1548 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 05:02:54.867549 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-a5b7673a-0c0b-4ba1-819e-1fb786e1f9e6 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:02:54.868110 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-a5b7673a-0c0b-4ba1-819e-1fb786e1f9e6 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 6a85f27c-bdfe-4580-8579-71ea2b71bbfd] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:02:54.874691 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a5b7673a-0c0b-4ba1-819e-1fb786e1f9e6 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:54.875189 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a5b7673a-0c0b-4ba1-819e-1fb786e1f9e6 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:54.875627 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a5b7673a-0c0b-4ba1-819e-1fb786e1f9e6 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:54.876328 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a5b7673a-0c0b-4ba1-819e-1fb786e1f9e6 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:54.876805 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a5b7673a-0c0b-4ba1-819e-1fb786e1f9e6 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:54.877391 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a5b7673a-0c0b-4ba1-819e-1fb786e1f9e6 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:54.951680 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell0:SELECT=12 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:54.960939 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-a5b7673a-0c0b-4ba1-819e-1fb786e1f9e6 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097689 Sep 20 05:02:54.961572 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 635/785] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Sep 20 05:02:54 2022] GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 05:02:55.893148 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-327064a4-d9d1-4591-9868-e5eb42786b16 req-35b3b33d-17c0-44c7-8127-ca33eca6240e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a85f27c-bdfe-4580-8579-71ea2b71bbfd", "tag": "f15fb1a3-73e1-48d8-b0d4-41cf678fb197"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:02:55.903014 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-327064a4-d9d1-4591-9868-e5eb42786b16 req-35b3b33d-17c0-44c7-8127-ca33eca6240e service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:02:55.903491 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-327064a4-d9d1-4591-9868-e5eb42786b16 req-35b3b33d-17c0-44c7-8127-ca33eca6240e service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:02:55.903904 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-327064a4-d9d1-4591-9868-e5eb42786b16 req-35b3b33d-17c0-44c7-8127-ca33eca6240e service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:02:55.915663 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-327064a4-d9d1-4591-9868-e5eb42786b16 req-35b3b33d-17c0-44c7-8127-ca33eca6240e service nova] Creating event network-changed:f15fb1a3-73e1-48d8-b0d4-41cf678fb197 for instance 6a85f27c-bdfe-4580-8579-71ea2b71bbfd on hv-cinder-75671 Sep 20 05:02:55.920678 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-327064a4-d9d1-4591-9868-e5eb42786b16 req-35b3b33d-17c0-44c7-8127-ca33eca6240e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031588 Sep 20 05:02:55.921292 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 636/786] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 05:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 05:03:25.350362 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=37,nova_api:DELETE=1 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:03:25.351207 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:03:25.355304 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-3605c3b6-6fc4-4374-a09a-fd18a67ef471 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:03:25.355884 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-3605c3b6-6fc4-4374-a09a-fd18a67ef471 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 6a85f27c-bdfe-4580-8579-71ea2b71bbfd] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:03:25.367312 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3605c3b6-6fc4-4374-a09a-fd18a67ef471 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:03:25.367804 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3605c3b6-6fc4-4374-a09a-fd18a67ef471 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:03:25.368244 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3605c3b6-6fc4-4374-a09a-fd18a67ef471 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:03:25.368991 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3605c3b6-6fc4-4374-a09a-fd18a67ef471 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:03:25.369445 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3605c3b6-6fc4-4374-a09a-fd18a67ef471 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:03:25.369875 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3605c3b6-6fc4-4374-a09a-fd18a67ef471 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:03:25.402874 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-3605c3b6-6fc4-4374-a09a-fd18a67ef471 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd/ips" status: 200 len: 145 microversion: 2.1 time: 0.053980 Sep 20 05:03:25.403732 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 637/787] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Sep 20 05:03:25 2022] GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd/ips => generated 145 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 05:03:28.963760 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-81b4d996-6682-4594-9462-4f0e2c3bbe5a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "811c21b9-ba81-4fe1-87a4-869fbfcc0ab0"}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:03:28.966124 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-81b4d996-6682-4594-9462-4f0e2c3bbe5a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 6a85f27c-bdfe-4580-8579-71ea2b71bbfd] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:03:28.971906 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-81b4d996-6682-4594-9462-4f0e2c3bbe5a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:03:28.972392 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-81b4d996-6682-4594-9462-4f0e2c3bbe5a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:03:28.972862 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-81b4d996-6682-4594-9462-4f0e2c3bbe5a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:03:28.973539 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-81b4d996-6682-4594-9462-4f0e2c3bbe5a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:03:28.973989 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-81b4d996-6682-4594-9462-4f0e2c3bbe5a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:03:28.974410 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-81b4d996-6682-4594-9462-4f0e2c3bbe5a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:03:29.242562 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-81b4d996-6682-4594-9462-4f0e2c3bbe5a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "POST /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283034 Sep 20 05:03:29.243258 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 638/788] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Sep 20 05:03:28 2022] POST /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 05:03:36.774310 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-1e1dbe19-9ed4-46da-94a5-dcf68762836c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:03:36.781756 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1e1dbe19-9ed4-46da-94a5-dcf68762836c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:03:36.782242 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1e1dbe19-9ed4-46da-94a5-dcf68762836c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:03:36.782680 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1e1dbe19-9ed4-46da-94a5-dcf68762836c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:03:36.842144 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-1e1dbe19-9ed4-46da-94a5-dcf68762836c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 6a85f27c-bdfe-4580-8579-71ea2b71bbfd] Going to try to stop instance {{(pid=126813) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 20 05:03:36.886076 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-1e1dbe19-9ed4-46da-94a5-dcf68762836c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "POST /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd/action" status: 202 len: 0 microversion: 2.1 time: 0.116528 Sep 20 05:03:36.886698 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 639/789] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Sep 20 05:03:36 2022] POST /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 20 05:03:36.895492 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-c4aa0b6a-2632-4625-8f0c-ece2f52d1228 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:03:36.896194 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-c4aa0b6a-2632-4625-8f0c-ece2f52d1228 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 6a85f27c-bdfe-4580-8579-71ea2b71bbfd] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:03:36.904657 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c4aa0b6a-2632-4625-8f0c-ece2f52d1228 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:03:36.906524 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c4aa0b6a-2632-4625-8f0c-ece2f52d1228 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:03:36.907350 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c4aa0b6a-2632-4625-8f0c-ece2f52d1228 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:03:36.908268 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c4aa0b6a-2632-4625-8f0c-ece2f52d1228 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:03:36.909134 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c4aa0b6a-2632-4625-8f0c-ece2f52d1228 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:03:36.909702 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c4aa0b6a-2632-4625-8f0c-ece2f52d1228 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:03:37.038770 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-c4aa0b6a-2632-4625-8f0c-ece2f52d1228 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1947f5ce1d794f05ae6272e8dba5d29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3218048072f048d9afc65ae138523bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:03:37.047777 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-c4aa0b6a-2632-4625-8f0c-ece2f52d1228 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd" status: 200 len: 1722 microversion: 2.1 time: 0.156332 Sep 20 05:03:37.048341 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 640/790] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:03:36 2022] GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:03:38.070662 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-b657e04c-a290-49bf-9d1b-7c9aa27190fc tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:03:38.071277 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-b657e04c-a290-49bf-9d1b-7c9aa27190fc tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 6a85f27c-bdfe-4580-8579-71ea2b71bbfd] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:03:38.077715 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b657e04c-a290-49bf-9d1b-7c9aa27190fc tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:03:38.078189 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b657e04c-a290-49bf-9d1b-7c9aa27190fc tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:03:38.078624 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b657e04c-a290-49bf-9d1b-7c9aa27190fc tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:03:38.079302 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b657e04c-a290-49bf-9d1b-7c9aa27190fc tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:03:38.079748 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b657e04c-a290-49bf-9d1b-7c9aa27190fc tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:03:38.080165 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b657e04c-a290-49bf-9d1b-7c9aa27190fc tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:03:38.208816 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-b657e04c-a290-49bf-9d1b-7c9aa27190fc tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1947f5ce1d794f05ae6272e8dba5d29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3218048072f048d9afc65ae138523bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:03:38.216955 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-b657e04c-a290-49bf-9d1b-7c9aa27190fc tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd" status: 200 len: 1722 microversion: 2.1 time: 0.150155 Sep 20 05:03:38.217513 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 641/791] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:03:38 2022] GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:03:39.240279 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-124936ce-8423-41e6-b2d1-4d754859b793 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:03:39.240958 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-124936ce-8423-41e6-b2d1-4d754859b793 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 6a85f27c-bdfe-4580-8579-71ea2b71bbfd] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:03:39.247957 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-124936ce-8423-41e6-b2d1-4d754859b793 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:03:39.248433 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-124936ce-8423-41e6-b2d1-4d754859b793 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:03:39.248906 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-124936ce-8423-41e6-b2d1-4d754859b793 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:03:39.249584 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-124936ce-8423-41e6-b2d1-4d754859b793 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:03:39.250028 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-124936ce-8423-41e6-b2d1-4d754859b793 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:03:39.250446 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-124936ce-8423-41e6-b2d1-4d754859b793 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:03:39.375853 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-124936ce-8423-41e6-b2d1-4d754859b793 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1947f5ce1d794f05ae6272e8dba5d29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3218048072f048d9afc65ae138523bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:03:39.384759 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-124936ce-8423-41e6-b2d1-4d754859b793 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd" status: 200 len: 1722 microversion: 2.1 time: 0.147688 Sep 20 05:03:39.385337 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 642/792] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:03:39 2022] GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:03:40.407712 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-f4e4a72a-8c04-44b2-8cfa-683e8df24d66 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:03:40.408366 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-f4e4a72a-8c04-44b2-8cfa-683e8df24d66 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 6a85f27c-bdfe-4580-8579-71ea2b71bbfd] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:03:40.414785 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f4e4a72a-8c04-44b2-8cfa-683e8df24d66 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:03:40.415761 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f4e4a72a-8c04-44b2-8cfa-683e8df24d66 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:03:40.416197 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f4e4a72a-8c04-44b2-8cfa-683e8df24d66 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:03:40.416911 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f4e4a72a-8c04-44b2-8cfa-683e8df24d66 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:03:40.417362 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f4e4a72a-8c04-44b2-8cfa-683e8df24d66 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:03:40.417786 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f4e4a72a-8c04-44b2-8cfa-683e8df24d66 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:03:40.547801 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-f4e4a72a-8c04-44b2-8cfa-683e8df24d66 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1947f5ce1d794f05ae6272e8dba5d29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3218048072f048d9afc65ae138523bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:03:40.555944 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-f4e4a72a-8c04-44b2-8cfa-683e8df24d66 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd" status: 200 len: 1722 microversion: 2.1 time: 0.152158 Sep 20 05:03:40.556506 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 643/793] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:03:40 2022] GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:03:41.578857 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-5b3003d5-15b0-4827-a9c7-9b9721d6bf8c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:03:41.579509 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-5b3003d5-15b0-4827-a9c7-9b9721d6bf8c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 6a85f27c-bdfe-4580-8579-71ea2b71bbfd] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:03:41.585952 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5b3003d5-15b0-4827-a9c7-9b9721d6bf8c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:03:41.586434 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5b3003d5-15b0-4827-a9c7-9b9721d6bf8c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:03:41.586869 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5b3003d5-15b0-4827-a9c7-9b9721d6bf8c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:03:41.587551 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5b3003d5-15b0-4827-a9c7-9b9721d6bf8c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:03:41.588000 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5b3003d5-15b0-4827-a9c7-9b9721d6bf8c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:03:41.588421 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5b3003d5-15b0-4827-a9c7-9b9721d6bf8c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:03:41.722014 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-5b3003d5-15b0-4827-a9c7-9b9721d6bf8c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1947f5ce1d794f05ae6272e8dba5d29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3218048072f048d9afc65ae138523bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:03:41.730840 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-5b3003d5-15b0-4827-a9c7-9b9721d6bf8c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd" status: 200 len: 1722 microversion: 2.1 time: 0.155792 Sep 20 05:03:41.731407 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 644/794] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:03:41 2022] GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:03:42.763426 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-b296c3de-7697-49cd-9c21-ea03690273a3 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:03:42.764297 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-b296c3de-7697-49cd-9c21-ea03690273a3 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 6a85f27c-bdfe-4580-8579-71ea2b71bbfd] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:03:42.770723 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b296c3de-7697-49cd-9c21-ea03690273a3 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:03:42.771204 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b296c3de-7697-49cd-9c21-ea03690273a3 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:03:42.771644 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b296c3de-7697-49cd-9c21-ea03690273a3 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:03:42.772331 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b296c3de-7697-49cd-9c21-ea03690273a3 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:03:42.772816 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b296c3de-7697-49cd-9c21-ea03690273a3 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:03:42.773260 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b296c3de-7697-49cd-9c21-ea03690273a3 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:03:42.901041 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-b296c3de-7697-49cd-9c21-ea03690273a3 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1947f5ce1d794f05ae6272e8dba5d29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3218048072f048d9afc65ae138523bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:03:42.909325 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-b296c3de-7697-49cd-9c21-ea03690273a3 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd" status: 200 len: 1722 microversion: 2.1 time: 0.150277 Sep 20 05:03:42.909893 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 645/795] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:03:42 2022] GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:03:43.932619 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-9ac8894e-fe57-46f0-8196-4475f03c6801 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:03:43.933324 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-9ac8894e-fe57-46f0-8196-4475f03c6801 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 6a85f27c-bdfe-4580-8579-71ea2b71bbfd] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:03:43.939755 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9ac8894e-fe57-46f0-8196-4475f03c6801 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:03:43.940231 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9ac8894e-fe57-46f0-8196-4475f03c6801 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:03:43.940684 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9ac8894e-fe57-46f0-8196-4475f03c6801 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:03:43.941370 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9ac8894e-fe57-46f0-8196-4475f03c6801 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:03:43.941815 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9ac8894e-fe57-46f0-8196-4475f03c6801 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:03:43.942235 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-9ac8894e-fe57-46f0-8196-4475f03c6801 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:03:44.073288 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-9ac8894e-fe57-46f0-8196-4475f03c6801 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1947f5ce1d794f05ae6272e8dba5d29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3218048072f048d9afc65ae138523bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:03:44.081900 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-9ac8894e-fe57-46f0-8196-4475f03c6801 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd" status: 200 len: 1722 microversion: 2.1 time: 0.153240 Sep 20 05:03:44.082540 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 646/796] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:03:43 2022] GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:03:45.109542 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-fcde5ad2-b6d1-467b-9c85-e2a3cde252bd tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:03:45.110196 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-fcde5ad2-b6d1-467b-9c85-e2a3cde252bd tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 6a85f27c-bdfe-4580-8579-71ea2b71bbfd] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:03:45.116641 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fcde5ad2-b6d1-467b-9c85-e2a3cde252bd tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:03:45.117125 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fcde5ad2-b6d1-467b-9c85-e2a3cde252bd tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:03:45.117560 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fcde5ad2-b6d1-467b-9c85-e2a3cde252bd tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:03:45.118256 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fcde5ad2-b6d1-467b-9c85-e2a3cde252bd tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:03:45.118712 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fcde5ad2-b6d1-467b-9c85-e2a3cde252bd tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:03:45.119138 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fcde5ad2-b6d1-467b-9c85-e2a3cde252bd tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:03:45.244417 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-fcde5ad2-b6d1-467b-9c85-e2a3cde252bd tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1947f5ce1d794f05ae6272e8dba5d29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3218048072f048d9afc65ae138523bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:03:45.252557 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-fcde5ad2-b6d1-467b-9c85-e2a3cde252bd tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd" status: 200 len: 1722 microversion: 2.1 time: 0.146883 Sep 20 05:03:45.253139 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 647/797] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:03:45 2022] GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:03:46.275219 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-2a404161-ccc4-4d05-8c44-f80afea12cce tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:03:46.275819 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-2a404161-ccc4-4d05-8c44-f80afea12cce tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 6a85f27c-bdfe-4580-8579-71ea2b71bbfd] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:03:46.282306 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2a404161-ccc4-4d05-8c44-f80afea12cce tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:03:46.282778 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2a404161-ccc4-4d05-8c44-f80afea12cce tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:03:46.283210 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2a404161-ccc4-4d05-8c44-f80afea12cce tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:03:46.283885 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2a404161-ccc4-4d05-8c44-f80afea12cce tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:03:46.284327 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2a404161-ccc4-4d05-8c44-f80afea12cce tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:03:46.284774 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2a404161-ccc4-4d05-8c44-f80afea12cce tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:03:46.412152 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-2a404161-ccc4-4d05-8c44-f80afea12cce tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1947f5ce1d794f05ae6272e8dba5d29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3218048072f048d9afc65ae138523bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:03:46.420962 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-2a404161-ccc4-4d05-8c44-f80afea12cce tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd" status: 200 len: 1722 microversion: 2.1 time: 0.149569 Sep 20 05:03:46.421532 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 648/798] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:03:46 2022] GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:03:47.444903 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-10776fbd-6b46-43d5-b458-fae4d9028e2b tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:03:47.445525 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-10776fbd-6b46-43d5-b458-fae4d9028e2b tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 6a85f27c-bdfe-4580-8579-71ea2b71bbfd] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:03:47.451915 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-10776fbd-6b46-43d5-b458-fae4d9028e2b tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:03:47.452398 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-10776fbd-6b46-43d5-b458-fae4d9028e2b tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:03:47.452900 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-10776fbd-6b46-43d5-b458-fae4d9028e2b tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:03:47.453607 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-10776fbd-6b46-43d5-b458-fae4d9028e2b tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:03:47.454055 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-10776fbd-6b46-43d5-b458-fae4d9028e2b tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:03:47.454478 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-10776fbd-6b46-43d5-b458-fae4d9028e2b tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:03:47.579854 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-10776fbd-6b46-43d5-b458-fae4d9028e2b tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1947f5ce1d794f05ae6272e8dba5d29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3218048072f048d9afc65ae138523bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:03:47.588458 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-10776fbd-6b46-43d5-b458-fae4d9028e2b tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd" status: 200 len: 1699 microversion: 2.1 time: 0.147501 Sep 20 05:03:47.589051 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 649/799] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:03:47 2022] GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd => generated 1699 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:03:47.610471 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-b99bec93-7fea-47bb-9af2-c34719649030 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:03:47.615987 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b99bec93-7fea-47bb-9af2-c34719649030 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:03:47.616469 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b99bec93-7fea-47bb-9af2-c34719649030 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:03:47.616940 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b99bec93-7fea-47bb-9af2-c34719649030 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:03:47.638251 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-b99bec93-7fea-47bb-9af2-c34719649030 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 6a85f27c-bdfe-4580-8579-71ea2b71bbfd] Going to try to start instance {{(pid=126813) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 20 05:03:47.662133 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:03:47.680973 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-b99bec93-7fea-47bb-9af2-c34719649030 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "POST /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd/action" status: 202 len: 0 microversion: 2.1 time: 0.073735 Sep 20 05:03:47.681558 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 650/800] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Sep 20 05:03:47 2022] POST /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 20 05:03:47.690000 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-83bae365-802a-441c-9bc3-21c680116763 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:03:47.690723 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-83bae365-802a-441c-9bc3-21c680116763 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 6a85f27c-bdfe-4580-8579-71ea2b71bbfd] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:03:47.697344 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-83bae365-802a-441c-9bc3-21c680116763 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:03:47.697759 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-83bae365-802a-441c-9bc3-21c680116763 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:03:47.698188 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-83bae365-802a-441c-9bc3-21c680116763 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:03:47.698877 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-83bae365-802a-441c-9bc3-21c680116763 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:03:47.699372 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-83bae365-802a-441c-9bc3-21c680116763 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:03:47.699793 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-83bae365-802a-441c-9bc3-21c680116763 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:03:47.835681 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-83bae365-802a-441c-9bc3-21c680116763 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1947f5ce1d794f05ae6272e8dba5d29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3218048072f048d9afc65ae138523bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:03:47.844631 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-83bae365-802a-441c-9bc3-21c680116763 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd" status: 200 len: 1708 microversion: 2.1 time: 0.158764 Sep 20 05:03:47.845208 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 651/801] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:03:47 2022] GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd => generated 1708 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:03:48.868940 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-57cbc051-23b9-4265-afb8-a0614b80f3ed tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:03:48.869664 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-57cbc051-23b9-4265-afb8-a0614b80f3ed tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 6a85f27c-bdfe-4580-8579-71ea2b71bbfd] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:03:48.877028 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-57cbc051-23b9-4265-afb8-a0614b80f3ed tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:03:48.877605 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-57cbc051-23b9-4265-afb8-a0614b80f3ed tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:03:48.878042 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-57cbc051-23b9-4265-afb8-a0614b80f3ed tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:03:48.878728 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-57cbc051-23b9-4265-afb8-a0614b80f3ed tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:03:48.879873 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-57cbc051-23b9-4265-afb8-a0614b80f3ed tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:03:48.880302 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-57cbc051-23b9-4265-afb8-a0614b80f3ed tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:03:49.010154 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-57cbc051-23b9-4265-afb8-a0614b80f3ed tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1947f5ce1d794f05ae6272e8dba5d29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3218048072f048d9afc65ae138523bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:03:49.019438 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-57cbc051-23b9-4265-afb8-a0614b80f3ed tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd" status: 200 len: 1712 microversion: 2.1 time: 0.155214 Sep 20 05:03:49.020143 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 652/802] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:03:48 2022] GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd => generated 1712 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 05:03:59.246339 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 20 05:03:59.246885 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: Tue Sep 20 05:03:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.27) !!! Sep 20 05:04:19.683910 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 20 05:04:19.684617 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: Tue Sep 20 05:04:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.27) !!! Sep 20 05:04:21.421361 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-abee625f-39a0-4fa8-9c28-f1f1e9b375cb tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:04:21.421909 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-abee625f-39a0-4fa8-9c28-f1f1e9b375cb tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 6a85f27c-bdfe-4580-8579-71ea2b71bbfd] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:04:21.424513 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_api:SELECT=32 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:04:21.425191 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell1:SELECT=13,nova_cell1:INSERT=1 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:04:21.433317 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-abee625f-39a0-4fa8-9c28-f1f1e9b375cb tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:04:21.433793 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-abee625f-39a0-4fa8-9c28-f1f1e9b375cb tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:04:21.434227 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-abee625f-39a0-4fa8-9c28-f1f1e9b375cb tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:04:21.434913 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-abee625f-39a0-4fa8-9c28-f1f1e9b375cb tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:04:21.435364 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-abee625f-39a0-4fa8-9c28-f1f1e9b375cb tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:04:21.435791 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-abee625f-39a0-4fa8-9c28-f1f1e9b375cb tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:04:21.514492 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.objects.instance [None req-abee625f-39a0-4fa8-9c28-f1f1e9b375cb tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lazy-loading 'services' on Instance uuid 6a85f27c-bdfe-4580-8579-71ea2b71bbfd {{(pid=126813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 05:04:21.583984 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-abee625f-39a0-4fa8-9c28-f1f1e9b375cb tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd/os-volume_attachments/811c21b9-ba81-4fe1-87a4-869fbfcc0ab0" status: 202 len: 0 microversion: 2.1 time: 0.166503 Sep 20 05:04:21.584723 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 653/803] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Sep 20 05:04:21 2022] DELETE /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd/os-volume_attachments/811c21b9-ba81-4fe1-87a4-869fbfcc0ab0 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 20 05:04:22.708088 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-b3475608-607e-42d2-92ee-f356715aa991 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:04:22.714378 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b3475608-607e-42d2-92ee-f356715aa991 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:04:22.714858 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b3475608-607e-42d2-92ee-f356715aa991 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:04:22.715292 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b3475608-607e-42d2-92ee-f356715aa991 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:04:22.736666 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-b3475608-607e-42d2-92ee-f356715aa991 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 6a85f27c-bdfe-4580-8579-71ea2b71bbfd] Going to try to stop instance {{(pid=126813) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 20 05:04:22.777759 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-b3475608-607e-42d2-92ee-f356715aa991 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "POST /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd/action" status: 202 len: 0 microversion: 2.1 time: 0.074211 Sep 20 05:04:22.778418 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 654/804] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Sep 20 05:04:22 2022] POST /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 20 05:04:22.786524 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-876cd74a-9d44-4c57-afc1-8118a1905669 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:04:22.787220 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-876cd74a-9d44-4c57-afc1-8118a1905669 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 6a85f27c-bdfe-4580-8579-71ea2b71bbfd] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:04:22.793943 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-876cd74a-9d44-4c57-afc1-8118a1905669 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:04:22.794552 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-876cd74a-9d44-4c57-afc1-8118a1905669 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:04:22.794992 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-876cd74a-9d44-4c57-afc1-8118a1905669 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:04:22.795693 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-876cd74a-9d44-4c57-afc1-8118a1905669 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:04:22.796144 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-876cd74a-9d44-4c57-afc1-8118a1905669 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:04:22.796567 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-876cd74a-9d44-4c57-afc1-8118a1905669 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:04:22.927587 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-876cd74a-9d44-4c57-afc1-8118a1905669 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1947f5ce1d794f05ae6272e8dba5d29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3218048072f048d9afc65ae138523bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:04:22.936022 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-876cd74a-9d44-4c57-afc1-8118a1905669 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd" status: 200 len: 1676 microversion: 2.1 time: 0.153398 Sep 20 05:04:22.936595 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 655/805] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:04:22 2022] GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:04:23.958313 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-54c975e6-e183-4f63-8acc-121e8ed3a4e5 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:04:23.958988 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-54c975e6-e183-4f63-8acc-121e8ed3a4e5 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 6a85f27c-bdfe-4580-8579-71ea2b71bbfd] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:04:23.965321 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-54c975e6-e183-4f63-8acc-121e8ed3a4e5 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:04:23.965803 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-54c975e6-e183-4f63-8acc-121e8ed3a4e5 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:04:23.966235 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-54c975e6-e183-4f63-8acc-121e8ed3a4e5 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:04:23.966913 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-54c975e6-e183-4f63-8acc-121e8ed3a4e5 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:04:23.967359 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-54c975e6-e183-4f63-8acc-121e8ed3a4e5 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:04:23.967774 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-54c975e6-e183-4f63-8acc-121e8ed3a4e5 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:04:24.096299 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-54c975e6-e183-4f63-8acc-121e8ed3a4e5 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1947f5ce1d794f05ae6272e8dba5d29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3218048072f048d9afc65ae138523bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:04:24.104712 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-54c975e6-e183-4f63-8acc-121e8ed3a4e5 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd" status: 200 len: 1676 microversion: 2.1 time: 0.150172 Sep 20 05:04:24.105267 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 656/806] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:04:23 2022] GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:04:25.128191 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-192d7a7e-f81b-4e2e-82b9-ecc80e83e56d tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:04:25.128941 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-192d7a7e-f81b-4e2e-82b9-ecc80e83e56d tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 6a85f27c-bdfe-4580-8579-71ea2b71bbfd] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:04:25.136017 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-192d7a7e-f81b-4e2e-82b9-ecc80e83e56d tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:04:25.136496 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-192d7a7e-f81b-4e2e-82b9-ecc80e83e56d tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:04:25.136955 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-192d7a7e-f81b-4e2e-82b9-ecc80e83e56d tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:04:25.137647 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-192d7a7e-f81b-4e2e-82b9-ecc80e83e56d tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:04:25.138093 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-192d7a7e-f81b-4e2e-82b9-ecc80e83e56d tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:04:25.138516 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-192d7a7e-f81b-4e2e-82b9-ecc80e83e56d tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:04:25.264174 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-192d7a7e-f81b-4e2e-82b9-ecc80e83e56d tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1947f5ce1d794f05ae6272e8dba5d29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3218048072f048d9afc65ae138523bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:04:25.272050 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-192d7a7e-f81b-4e2e-82b9-ecc80e83e56d tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd" status: 200 len: 1676 microversion: 2.1 time: 0.147784 Sep 20 05:04:25.272646 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 657/807] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:04:25 2022] GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:04:26.294830 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-c47414d7-d281-45db-9903-ef30549df7b9 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:04:26.295433 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-c47414d7-d281-45db-9903-ef30549df7b9 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 6a85f27c-bdfe-4580-8579-71ea2b71bbfd] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:04:26.301897 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c47414d7-d281-45db-9903-ef30549df7b9 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:04:26.302373 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c47414d7-d281-45db-9903-ef30549df7b9 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:04:26.302808 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c47414d7-d281-45db-9903-ef30549df7b9 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:04:26.303490 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c47414d7-d281-45db-9903-ef30549df7b9 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:04:26.303940 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c47414d7-d281-45db-9903-ef30549df7b9 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:04:26.304388 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c47414d7-d281-45db-9903-ef30549df7b9 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:04:26.436246 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-c47414d7-d281-45db-9903-ef30549df7b9 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1947f5ce1d794f05ae6272e8dba5d29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3218048072f048d9afc65ae138523bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:04:26.443960 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-c47414d7-d281-45db-9903-ef30549df7b9 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd" status: 200 len: 1676 microversion: 2.1 time: 0.153001 Sep 20 05:04:26.444524 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 658/808] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:04:26 2022] GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:04:27.467448 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-b2a78893-c52f-4355-9287-4be6be1d4cf8 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:04:27.468091 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-b2a78893-c52f-4355-9287-4be6be1d4cf8 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 6a85f27c-bdfe-4580-8579-71ea2b71bbfd] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:04:27.474037 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b2a78893-c52f-4355-9287-4be6be1d4cf8 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:04:27.474516 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b2a78893-c52f-4355-9287-4be6be1d4cf8 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:04:27.474952 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b2a78893-c52f-4355-9287-4be6be1d4cf8 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:04:27.475639 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b2a78893-c52f-4355-9287-4be6be1d4cf8 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:04:27.476089 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b2a78893-c52f-4355-9287-4be6be1d4cf8 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:04:27.476513 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b2a78893-c52f-4355-9287-4be6be1d4cf8 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:04:27.601277 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-b2a78893-c52f-4355-9287-4be6be1d4cf8 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1947f5ce1d794f05ae6272e8dba5d29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3218048072f048d9afc65ae138523bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:04:27.609450 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-b2a78893-c52f-4355-9287-4be6be1d4cf8 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd" status: 200 len: 1676 microversion: 2.1 time: 0.146073 Sep 20 05:04:27.610007 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 659/809] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:04:27 2022] GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd => generated 1676 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:04:28.632736 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-a2e2162c-4df8-4ee0-b933-695b5b64156f tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:04:28.633415 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-a2e2162c-4df8-4ee0-b933-695b5b64156f tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 6a85f27c-bdfe-4580-8579-71ea2b71bbfd] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:04:28.639339 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a2e2162c-4df8-4ee0-b933-695b5b64156f tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:04:28.639813 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a2e2162c-4df8-4ee0-b933-695b5b64156f tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:04:28.640242 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a2e2162c-4df8-4ee0-b933-695b5b64156f tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:04:28.641196 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a2e2162c-4df8-4ee0-b933-695b5b64156f tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:04:28.641640 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a2e2162c-4df8-4ee0-b933-695b5b64156f tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:04:28.642059 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a2e2162c-4df8-4ee0-b933-695b5b64156f tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:04:28.766397 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-a2e2162c-4df8-4ee0-b933-695b5b64156f tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1947f5ce1d794f05ae6272e8dba5d29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3218048072f048d9afc65ae138523bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:04:28.774261 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-a2e2162c-4df8-4ee0-b933-695b5b64156f tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd" status: 200 len: 1676 microversion: 2.1 time: 0.145421 Sep 20 05:04:28.775309 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 660/810] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:04:28 2022] GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd => generated 1676 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:04:29.797347 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-0ea2ddb4-fec2-4f46-8bb5-3aa433702b1e tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:04:29.798014 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-0ea2ddb4-fec2-4f46-8bb5-3aa433702b1e tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 6a85f27c-bdfe-4580-8579-71ea2b71bbfd] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:04:29.804449 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0ea2ddb4-fec2-4f46-8bb5-3aa433702b1e tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:04:29.804950 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0ea2ddb4-fec2-4f46-8bb5-3aa433702b1e tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:04:29.805382 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0ea2ddb4-fec2-4f46-8bb5-3aa433702b1e tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:04:29.806675 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0ea2ddb4-fec2-4f46-8bb5-3aa433702b1e tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:04:29.807121 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0ea2ddb4-fec2-4f46-8bb5-3aa433702b1e tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:04:29.807539 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0ea2ddb4-fec2-4f46-8bb5-3aa433702b1e tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:04:29.935559 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-0ea2ddb4-fec2-4f46-8bb5-3aa433702b1e tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1947f5ce1d794f05ae6272e8dba5d29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3218048072f048d9afc65ae138523bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:04:29.943188 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-0ea2ddb4-fec2-4f46-8bb5-3aa433702b1e tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd" status: 200 len: 1676 microversion: 2.1 time: 0.149749 Sep 20 05:04:29.943757 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 661/811] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:04:29 2022] GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:04:30.966211 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-2114dee6-c6c4-4745-89c0-d50d9ad8aef5 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:04:30.967156 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-2114dee6-c6c4-4745-89c0-d50d9ad8aef5 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 6a85f27c-bdfe-4580-8579-71ea2b71bbfd] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:04:30.975025 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2114dee6-c6c4-4745-89c0-d50d9ad8aef5 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:04:30.975502 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2114dee6-c6c4-4745-89c0-d50d9ad8aef5 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:04:30.975939 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2114dee6-c6c4-4745-89c0-d50d9ad8aef5 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:04:30.976642 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2114dee6-c6c4-4745-89c0-d50d9ad8aef5 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:04:30.977092 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2114dee6-c6c4-4745-89c0-d50d9ad8aef5 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:04:30.977510 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2114dee6-c6c4-4745-89c0-d50d9ad8aef5 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:04:31.104976 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-2114dee6-c6c4-4745-89c0-d50d9ad8aef5 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1947f5ce1d794f05ae6272e8dba5d29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3218048072f048d9afc65ae138523bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:04:31.112549 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-2114dee6-c6c4-4745-89c0-d50d9ad8aef5 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd" status: 200 len: 1676 microversion: 2.1 time: 0.151012 Sep 20 05:04:31.113138 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 662/812] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:04:30 2022] GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:04:32.135704 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-273d8994-a9ce-4a71-9903-f61d24c65a5e tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:04:32.136353 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-273d8994-a9ce-4a71-9903-f61d24c65a5e tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 6a85f27c-bdfe-4580-8579-71ea2b71bbfd] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:04:32.143063 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-273d8994-a9ce-4a71-9903-f61d24c65a5e tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:04:32.143537 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-273d8994-a9ce-4a71-9903-f61d24c65a5e tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:04:32.143976 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-273d8994-a9ce-4a71-9903-f61d24c65a5e tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:04:32.144697 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-273d8994-a9ce-4a71-9903-f61d24c65a5e tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:04:32.145146 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-273d8994-a9ce-4a71-9903-f61d24c65a5e tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:04:32.145566 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-273d8994-a9ce-4a71-9903-f61d24c65a5e tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:04:32.510134 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-273d8994-a9ce-4a71-9903-f61d24c65a5e tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1947f5ce1d794f05ae6272e8dba5d29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3218048072f048d9afc65ae138523bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:04:32.518177 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-273d8994-a9ce-4a71-9903-f61d24c65a5e tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd" status: 200 len: 1676 microversion: 2.1 time: 0.386850 Sep 20 05:04:32.518743 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 663/813] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:04:32 2022] GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd => generated 1676 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:04:33.541317 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-e0badc50-7ece-4888-97ca-1eeccafdb306 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:04:33.541972 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-e0badc50-7ece-4888-97ca-1eeccafdb306 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 6a85f27c-bdfe-4580-8579-71ea2b71bbfd] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:04:33.548358 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e0badc50-7ece-4888-97ca-1eeccafdb306 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:04:33.548865 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e0badc50-7ece-4888-97ca-1eeccafdb306 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:04:33.549301 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e0badc50-7ece-4888-97ca-1eeccafdb306 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:04:33.549979 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e0badc50-7ece-4888-97ca-1eeccafdb306 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:04:33.550427 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e0badc50-7ece-4888-97ca-1eeccafdb306 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:04:33.550852 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e0badc50-7ece-4888-97ca-1eeccafdb306 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:04:33.674671 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-e0badc50-7ece-4888-97ca-1eeccafdb306 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1947f5ce1d794f05ae6272e8dba5d29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3218048072f048d9afc65ae138523bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:04:33.683145 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-e0badc50-7ece-4888-97ca-1eeccafdb306 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd" status: 200 len: 1653 microversion: 2.1 time: 0.146158 Sep 20 05:04:33.683718 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 664/814] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:04:33 2022] GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd => generated 1653 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:04:33.705198 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-b9a0b68b-68c4-4978-852a-0a33fec84f9c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:04:33.710855 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b9a0b68b-68c4-4978-852a-0a33fec84f9c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:04:33.711328 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b9a0b68b-68c4-4978-852a-0a33fec84f9c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:04:33.711758 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b9a0b68b-68c4-4978-852a-0a33fec84f9c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:04:33.733575 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-b9a0b68b-68c4-4978-852a-0a33fec84f9c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 6a85f27c-bdfe-4580-8579-71ea2b71bbfd] Going to try to start instance {{(pid=126813) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 20 05:04:33.774146 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-b9a0b68b-68c4-4978-852a-0a33fec84f9c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "POST /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd/action" status: 202 len: 0 microversion: 2.1 time: 0.072251 Sep 20 05:04:33.775241 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 665/815] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Sep 20 05:04:33 2022] POST /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 20 05:04:33.783389 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-c0c109c4-2f2c-4f9b-a1a4-e1935cd3d1ea tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:04:33.784086 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-c0c109c4-2f2c-4f9b-a1a4-e1935cd3d1ea tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 6a85f27c-bdfe-4580-8579-71ea2b71bbfd] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:04:33.790990 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c0c109c4-2f2c-4f9b-a1a4-e1935cd3d1ea tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:04:33.791532 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c0c109c4-2f2c-4f9b-a1a4-e1935cd3d1ea tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:04:33.791907 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c0c109c4-2f2c-4f9b-a1a4-e1935cd3d1ea tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:04:33.792689 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c0c109c4-2f2c-4f9b-a1a4-e1935cd3d1ea tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:04:33.793132 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c0c109c4-2f2c-4f9b-a1a4-e1935cd3d1ea tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:04:33.793673 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c0c109c4-2f2c-4f9b-a1a4-e1935cd3d1ea tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:04:33.927369 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-c0c109c4-2f2c-4f9b-a1a4-e1935cd3d1ea tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1947f5ce1d794f05ae6272e8dba5d29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3218048072f048d9afc65ae138523bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:04:33.931082 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:04:33.937116 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-c0c109c4-2f2c-4f9b-a1a4-e1935cd3d1ea tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd" status: 200 len: 1662 microversion: 2.1 time: 0.157631 Sep 20 05:04:33.937895 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 666/816] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:04:33 2022] GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd => generated 1662 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:04:34.960771 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-680007c7-dd8b-479f-a140-ccab3b95ba7c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:04:34.961382 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-680007c7-dd8b-479f-a140-ccab3b95ba7c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 6a85f27c-bdfe-4580-8579-71ea2b71bbfd] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:04:34.969702 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-680007c7-dd8b-479f-a140-ccab3b95ba7c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:04:34.970185 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-680007c7-dd8b-479f-a140-ccab3b95ba7c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:04:34.970618 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-680007c7-dd8b-479f-a140-ccab3b95ba7c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:04:34.971302 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-680007c7-dd8b-479f-a140-ccab3b95ba7c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:04:34.971760 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-680007c7-dd8b-479f-a140-ccab3b95ba7c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:04:34.972183 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-680007c7-dd8b-479f-a140-ccab3b95ba7c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:04:35.101410 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-680007c7-dd8b-479f-a140-ccab3b95ba7c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1947f5ce1d794f05ae6272e8dba5d29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3218048072f048d9afc65ae138523bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:04:35.109129 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-680007c7-dd8b-479f-a140-ccab3b95ba7c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd" status: 200 len: 1662 microversion: 2.1 time: 0.152991 Sep 20 05:04:35.109698 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 667/817] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:04:34 2022] GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd => generated 1662 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:04:36.132080 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-b2f865a4-b39a-4627-8225-e90cc882b022 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:04:36.132747 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-b2f865a4-b39a-4627-8225-e90cc882b022 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 6a85f27c-bdfe-4580-8579-71ea2b71bbfd] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:04:36.139786 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b2f865a4-b39a-4627-8225-e90cc882b022 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:04:36.140259 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b2f865a4-b39a-4627-8225-e90cc882b022 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:04:36.140966 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b2f865a4-b39a-4627-8225-e90cc882b022 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:04:36.141648 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b2f865a4-b39a-4627-8225-e90cc882b022 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:04:36.142092 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b2f865a4-b39a-4627-8225-e90cc882b022 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:04:36.142509 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b2f865a4-b39a-4627-8225-e90cc882b022 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:04:36.273635 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-b2f865a4-b39a-4627-8225-e90cc882b022 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1947f5ce1d794f05ae6272e8dba5d29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3218048072f048d9afc65ae138523bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:04:36.281224 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-b2f865a4-b39a-4627-8225-e90cc882b022 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd" status: 200 len: 1666 microversion: 2.1 time: 0.153119 Sep 20 05:04:36.281780 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 668/818] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:04:36 2022] GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd => generated 1666 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 05:05:08.386819 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-c6b318a5-7672-4d8a-9aa8-bbfb263a0553 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:05:08.389142 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-c6b318a5-7672-4d8a-9aa8-bbfb263a0553 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 6a85f27c-bdfe-4580-8579-71ea2b71bbfd] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:05:08.391513 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_api:SELECT=32 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:05:08.392404 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell1:SELECT=12 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:05:08.398034 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c6b318a5-7672-4d8a-9aa8-bbfb263a0553 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:05:08.398510 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c6b318a5-7672-4d8a-9aa8-bbfb263a0553 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:05:08.398938 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c6b318a5-7672-4d8a-9aa8-bbfb263a0553 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:05:08.400126 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c6b318a5-7672-4d8a-9aa8-bbfb263a0553 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:05:08.400558 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c6b318a5-7672-4d8a-9aa8-bbfb263a0553 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:05:08.401017 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c6b318a5-7672-4d8a-9aa8-bbfb263a0553 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:05:08.429753 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-c6b318a5-7672-4d8a-9aa8-bbfb263a0553 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046818 Sep 20 05:05:08.430283 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 669/819] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Sep 20 05:05:08 2022] GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 20 05:05:08.491643 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-5a4ce3d0-820e-4e09-b742-54827bbeace5 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:05:08.492131 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-5a4ce3d0-820e-4e09-b742-54827bbeace5 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 6a85f27c-bdfe-4580-8579-71ea2b71bbfd] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:05:08.497939 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5a4ce3d0-820e-4e09-b742-54827bbeace5 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:05:08.498415 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5a4ce3d0-820e-4e09-b742-54827bbeace5 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:05:08.498846 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5a4ce3d0-820e-4e09-b742-54827bbeace5 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:05:08.499519 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5a4ce3d0-820e-4e09-b742-54827bbeace5 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:05:08.499966 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5a4ce3d0-820e-4e09-b742-54827bbeace5 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:05:08.500383 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5a4ce3d0-820e-4e09-b742-54827bbeace5 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:05:08.525511 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-5a4ce3d0-820e-4e09-b742-54827bbeace5 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 6a85f27c-bdfe-4580-8579-71ea2b71bbfd] Going to try to terminate instance {{(pid=126813) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 20 05:05:08.607452 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-5a4ce3d0-820e-4e09-b742-54827bbeace5 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd" status: 204 len: 0 microversion: 2.1 time: 0.119201 Sep 20 05:05:08.608221 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 670/820] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Sep 20 05:05:08 2022] DELETE /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 20 05:05:08.616311 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-8da82b7e-1461-4432-86be-0306726272b3 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:05:08.617118 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-8da82b7e-1461-4432-86be-0306726272b3 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 6a85f27c-bdfe-4580-8579-71ea2b71bbfd] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:05:08.622713 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8da82b7e-1461-4432-86be-0306726272b3 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:05:08.623193 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8da82b7e-1461-4432-86be-0306726272b3 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:05:08.623633 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8da82b7e-1461-4432-86be-0306726272b3 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:05:08.624319 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8da82b7e-1461-4432-86be-0306726272b3 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:05:08.624809 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8da82b7e-1461-4432-86be-0306726272b3 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:05:08.625313 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8da82b7e-1461-4432-86be-0306726272b3 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:05:08.751185 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-8da82b7e-1461-4432-86be-0306726272b3 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1947f5ce1d794f05ae6272e8dba5d29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3218048072f048d9afc65ae138523bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:05:08.759383 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-8da82b7e-1461-4432-86be-0306726272b3 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd" status: 200 len: 1672 microversion: 2.1 time: 0.146436 Sep 20 05:05:08.759942 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 671/821] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:05:08 2022] GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd => generated 1672 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:05:09.783161 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-fcab1309-c415-4c5f-a58b-1e25a8947a1a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:05:09.783825 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-fcab1309-c415-4c5f-a58b-1e25a8947a1a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 6a85f27c-bdfe-4580-8579-71ea2b71bbfd] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:05:09.790287 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fcab1309-c415-4c5f-a58b-1e25a8947a1a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:05:09.790770 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fcab1309-c415-4c5f-a58b-1e25a8947a1a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:05:09.791210 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fcab1309-c415-4c5f-a58b-1e25a8947a1a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:05:09.791929 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fcab1309-c415-4c5f-a58b-1e25a8947a1a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:05:09.792381 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fcab1309-c415-4c5f-a58b-1e25a8947a1a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:05:09.792838 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fcab1309-c415-4c5f-a58b-1e25a8947a1a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:05:09.918964 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-fcab1309-c415-4c5f-a58b-1e25a8947a1a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1947f5ce1d794f05ae6272e8dba5d29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3218048072f048d9afc65ae138523bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:05:09.926757 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-fcab1309-c415-4c5f-a58b-1e25a8947a1a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd" status: 200 len: 1672 microversion: 2.1 time: 0.147486 Sep 20 05:05:09.927332 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 672/822] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:05:09 2022] GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd => generated 1672 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:05:10.951104 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-3875c803-bef5-4dcb-9642-ed2fb9fb1f81 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:05:10.951761 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-3875c803-bef5-4dcb-9642-ed2fb9fb1f81 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 6a85f27c-bdfe-4580-8579-71ea2b71bbfd] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:05:10.958258 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3875c803-bef5-4dcb-9642-ed2fb9fb1f81 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:05:10.958740 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3875c803-bef5-4dcb-9642-ed2fb9fb1f81 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:05:10.959178 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3875c803-bef5-4dcb-9642-ed2fb9fb1f81 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:05:10.959872 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3875c803-bef5-4dcb-9642-ed2fb9fb1f81 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:05:10.960333 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3875c803-bef5-4dcb-9642-ed2fb9fb1f81 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:05:10.960787 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3875c803-bef5-4dcb-9642-ed2fb9fb1f81 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:05:11.092440 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-3875c803-bef5-4dcb-9642-ed2fb9fb1f81 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1947f5ce1d794f05ae6272e8dba5d29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3218048072f048d9afc65ae138523bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:05:11.100144 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-3875c803-bef5-4dcb-9642-ed2fb9fb1f81 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd" status: 200 len: 1672 microversion: 2.1 time: 0.152992 Sep 20 05:05:11.100739 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 673/823] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:05:10 2022] GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:05:11.429999 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-de32f609-c4c3-4634-a49e-de626ed4accf req-d458a440-1d0c-4e13-a2e4-c17508499fc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a85f27c-bdfe-4580-8579-71ea2b71bbfd", "name": "network-vif-deleted", "tag": "f15fb1a3-73e1-48d8-b0d4-41cf678fb197"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:05:11.439320 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-de32f609-c4c3-4634-a49e-de626ed4accf req-d458a440-1d0c-4e13-a2e4-c17508499fc0 service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:05:11.439798 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-de32f609-c4c3-4634-a49e-de626ed4accf req-d458a440-1d0c-4e13-a2e4-c17508499fc0 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:05:11.440303 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-de32f609-c4c3-4634-a49e-de626ed4accf req-d458a440-1d0c-4e13-a2e4-c17508499fc0 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:05:11.451635 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-de32f609-c4c3-4634-a49e-de626ed4accf req-d458a440-1d0c-4e13-a2e4-c17508499fc0 service nova] Creating event network-vif-deleted:f15fb1a3-73e1-48d8-b0d4-41cf678fb197 for instance 6a85f27c-bdfe-4580-8579-71ea2b71bbfd on hv-cinder-75671 Sep 20 05:05:11.456414 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-de32f609-c4c3-4634-a49e-de626ed4accf req-d458a440-1d0c-4e13-a2e4-c17508499fc0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030182 Sep 20 05:05:11.457045 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 674/824] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 05:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 05:05:12.125060 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-f42322d0-dad6-4248-8e15-0b9544e0999e tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:05:12.125923 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-f42322d0-dad6-4248-8e15-0b9544e0999e tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 6a85f27c-bdfe-4580-8579-71ea2b71bbfd] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:05:12.132351 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f42322d0-dad6-4248-8e15-0b9544e0999e tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:05:12.132872 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f42322d0-dad6-4248-8e15-0b9544e0999e tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:05:12.133328 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f42322d0-dad6-4248-8e15-0b9544e0999e tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:05:12.134586 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f42322d0-dad6-4248-8e15-0b9544e0999e tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:05:12.135035 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f42322d0-dad6-4248-8e15-0b9544e0999e tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:05:12.135660 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f42322d0-dad6-4248-8e15-0b9544e0999e tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:05:12.151779 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.wsgi [None req-f42322d0-dad6-4248-8e15-0b9544e0999e tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] HTTP exception thrown: Instance 6a85f27c-bdfe-4580-8579-71ea2b71bbfd could not be found. Sep 20 05:05:12.153467 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-f42322d0-dad6-4248-8e15-0b9544e0999e tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Request method failure captured: Sep 20 05:05:12.153467 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: request: GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd HTTP/1.1 Sep 20 05:05:12.153467 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept: application/json Sep 20 05:05:12.153467 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept-Encoding: identity Sep 20 05:05:12.153467 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Connection: close Sep 20 05:05:12.153467 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Length: 0 Sep 20 05:05:12.153467 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Type: application/json Sep 20 05:05:12.153467 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Host: 10.222.0.27 Sep 20 05:05:12.153467 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Openstack-System-Scope: None Sep 20 05:05:12.153467 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: User-Agent: python-urllib3/1.26.12 Sep 20 05:05:12.153467 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Auth-Token: gAAAAABjKUlxz9xxkTj8dm7Vm-I1IR7M6WZyKsnfLxXS8XrLfdbXZFHlewEX9Kqhk5nRbTsy0G2wqWNmc9u10aD6dqjwV2Gxk9D843PW3MsvZguhxpHed6vEIu4-xDvVwlfkOn_vX-pB9CKAqIgXJohltAUGYaDZFF5Hhihp8yy2_jOErOcQ3ck Sep 20 05:05:12.153467 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Id: None Sep 20 05:05:12.153467 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Name: None Sep 20 05:05:12.153467 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Identity-Status: Confirmed Sep 20 05:05:12.153467 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Is-Admin-Project: True Sep 20 05:05:12.153467 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Id: default Sep 20 05:05:12.153467 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Name: Default Sep 20 05:05:12.153467 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Id: 3218048072f048d9afc65ae138523bfd Sep 20 05:05:12.153467 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Name: tempest-AttachVolumeTestJSON-1068414702 Sep 20 05:05:12.153467 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Role: reader,member Sep 20 05:05:12.153467 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Roles: reader,member Sep 20 05:05:12.154924 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3218048072f048d9afc65ae138523bfd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3218048072f048d9afc65ae138523bfd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3218048072f048d9afc65ae138523bfd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3218048072f048d9afc65ae138523bfd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 05:05:12.154924 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant: tempest-AttachVolumeTestJSON-1068414702 Sep 20 05:05:12.154924 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Id: 3218048072f048d9afc65ae138523bfd Sep 20 05:05:12.154924 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1068414702 Sep 20 05:05:12.154924 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User: tempest-AttachVolumeTestJSON-1068414702-project Sep 20 05:05:12.154924 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Id: default Sep 20 05:05:12.154924 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Name: Default Sep 20 05:05:12.154924 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Id: 1947f5ce1d794f05ae6272e8dba5d29c Sep 20 05:05:12.154924 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Name: tempest-AttachVolumeTestJSON-1068414702-project Sep 20 05:05:12.154924 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: method: > Sep 20 05:05:12.154924 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: exception: Instance 6a85f27c-bdfe-4580-8579-71ea2b71bbfd could not be found. Sep 20 05:05:12.154924 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: action_args: {'id': '6a85f27c-bdfe-4580-8579-71ea2b71bbfd'} Sep 20 05:05:12.155923 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 05:05:12.155923 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:05:12.155923 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 05:05:12.155923 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 05:05:12.155923 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 05:05:12.155923 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 05:05:12.155923 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 05:05:12.155923 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 05:05:12.155923 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 05:05:12.155923 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 05:05:12.155923 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a85f27c-bdfe-4580-8579-71ea2b71bbfd could not be found. Sep 20 05:05:12.155923 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:05:12.155923 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 05:05:12.155923 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:05:12.155923 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:05:12.155923 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 05:05:12.155923 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 05:05:12.155923 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 05:05:12.155923 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 05:05:12.155923 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 05:05:12.157746 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 05:05:12.157746 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 05:05:12.157746 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 05:05:12.157746 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 05:05:12.157746 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 05:05:12.157746 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 05:05:12.157746 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 05:05:12.157746 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a85f27c-bdfe-4580-8579-71ea2b71bbfd could not be found. Sep 20 05:05:12.157746 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:05:12.157746 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 05:05:12.157746 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:05:12.157746 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:05:12.157746 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 05:05:12.157746 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 05:05:12.157746 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 05:05:12.157746 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 05:05:12.157746 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a85f27c-bdfe-4580-8579-71ea2b71bbfd could not be found. Sep 20 05:05:12.157746 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:05:12.159161 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-f42322d0-dad6-4248-8e15-0b9544e0999e tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Returning 404 to user: Instance 6a85f27c-bdfe-4580-8579-71ea2b71bbfd could not be found. {{(pid=126813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 05:05:12.159161 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-f42322d0-dad6-4248-8e15-0b9544e0999e tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd" status: 404 len: 111 microversion: 2.1 time: 0.034828 Sep 20 05:05:12.159161 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 675/825] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:05:12 2022] GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 20 05:05:12.163792 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-d2117514-b9ac-42e3-9ce0-6a9566fa01ce tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '.version_select at 0x7f2e4a6c48b0>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:05:12.168259 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d2117514-b9ac-42e3-9ce0-6a9566fa01ce tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [ec83e9a1-3867-4df5-a834-11d8e7c8fc1c] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 20 05:05:13.175581 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO oslo.messaging._drivers.impl_rabbit [None req-d2117514-b9ac-42e3-9ce0-6a9566fa01ce tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [ec83e9a1-3867-4df5-a834-11d8e7c8fc1c] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 43606. Sep 20 05:05:13.198706 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-d2117514-b9ac-42e3-9ce0-6a9566fa01ce tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-361722205" status: 202 len: 0 microversion: 2.1 time: 1.038492 Sep 20 05:05:13.199291 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 676/826] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Sep 20 05:05:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-361722205 => generated 0 bytes in 1040 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 20 05:05:13.803681 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-61c66f06-b4d9-4368-9849-a3f2a3784d7b tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Action: 'create', calling method: .version_select at 0x7f2e4a4cfdc0>, body: {"keypair": {"name": "tempest-keypair-246452007", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+8elhWWET5psTxlITWEODauRQo768XqccY9SA0Ds1xrp2BBONi79qrG9yCkgg5ALfEshyxf2rgm1wibvcuo13kzmOJWHhyf41kx7C1Rw1U2RQ/7RU3eX98e6AlSInxrw=="}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:05:13.820025 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-61c66f06-b4d9-4368-9849-a3f2a3784d7b tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Getting quotas for project 3218048072f048d9afc65ae138523bfd. Resources: {'key_pairs'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 05:05:13.824557 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-61c66f06-b4d9-4368-9849-a3f2a3784d7b tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Getting quotas for user 1947f5ce1d794f05ae6272e8dba5d29c and project 3218048072f048d9afc65ae138523bfd. Resources: {'key_pairs'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 05:05:13.855842 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-61c66f06-b4d9-4368-9849-a3f2a3784d7b tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.056016 Sep 20 05:05:13.856433 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 677/827] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Sep 20 05:05:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 05:05:15.114255 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-0d0629c6-6a64-40d1-a9d5-110549f4636a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2108403272", "imageRef": "080ea053-830e-4470-a886-0ab99b0ab3e0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "447d3db5-30f6-43d8-9751-379a0d9ed4d0"}], "security_groups": [{"name": "tempest-securitygroup--1784742817"}], "key_name": "tempest-keypair-246452007", "user_data": "}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:05:15.218924 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.network.neutron [None req-0d0629c6-6a64-40d1-a9d5-110549f4636a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] validate_networks() for [('447d3db5-30f6-43d8-9751-379a0d9ed4d0', None, None, None, None, None)] {{(pid=126813) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 20 05:05:15.254131 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 20 05:05:15.254686 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: Tue Sep 20 05:05:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.27) !!! Sep 20 05:05:15.585654 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-0d0629c6-6a64-40d1-a9d5-110549f4636a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Flavor limits 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 20 05:05:15.586078 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-0d0629c6-6a64-40d1-a9d5-110549f4636a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Image limits 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 20 05:05:15.586544 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-0d0629c6-6a64-40d1-a9d5-110549f4636a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Flavor pref 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 20 05:05:15.586946 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-0d0629c6-6a64-40d1-a9d5-110549f4636a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Image pref 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 20 05:05:15.587349 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-0d0629c6-6a64-40d1-a9d5-110549f4636a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 20 05:05:15.595853 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0d0629c6-6a64-40d1-a9d5-110549f4636a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:05:15.596324 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0d0629c6-6a64-40d1-a9d5-110549f4636a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:05:15.596789 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0d0629c6-6a64-40d1-a9d5-110549f4636a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:05:15.597506 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0d0629c6-6a64-40d1-a9d5-110549f4636a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:05:15.597953 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0d0629c6-6a64-40d1-a9d5-110549f4636a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:05:15.598368 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0d0629c6-6a64-40d1-a9d5-110549f4636a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:05:15.614829 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-0d0629c6-6a64-40d1-a9d5-110549f4636a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Getting quotas for project 3218048072f048d9afc65ae138523bfd. Resources: {'ram', 'cores', 'instances'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 05:05:15.619340 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-0d0629c6-6a64-40d1-a9d5-110549f4636a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Getting quotas for user 1947f5ce1d794f05ae6272e8dba5d29c and project 3218048072f048d9afc65ae138523bfd. Resources: {'ram', 'cores', 'instances'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 05:05:15.630029 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-0d0629c6-6a64-40d1-a9d5-110549f4636a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Going to run 1 instances... {{(pid=126813) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 20 05:05:15.632264 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-0d0629c6-6a64-40d1-a9d5-110549f4636a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 9d761bfd-506d-431d-8b35-44697bcdb58a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='080ea053-830e-4470-a886-0ab99b0ab3e0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126813) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 20 05:05:15.677073 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-0d0629c6-6a64-40d1-a9d5-110549f4636a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.566997 Sep 20 05:05:15.677708 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 678/828] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Sep 20 05:05:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 20 05:05:15.688908 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-8ee04d08-329e-4f2f-ad9c-03445b9d10d4 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:05:15.689510 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-8ee04d08-329e-4f2f-ad9c-03445b9d10d4 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 9d761bfd-506d-431d-8b35-44697bcdb58a] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:05:15.744817 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-8ee04d08-329e-4f2f-ad9c-03445b9d10d4 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1947f5ce1d794f05ae6272e8dba5d29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3218048072f048d9afc65ae138523bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:05:15.752447 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-8ee04d08-329e-4f2f-ad9c-03445b9d10d4 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a" status: 200 len: 1237 microversion: 2.1 time: 0.067157 Sep 20 05:05:15.753037 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 679/829] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:05:15 2022] GET /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a => generated 1237 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:05:16.775202 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-f6748556-544f-4e8a-98e7-93b8dc6a7da4 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:05:16.775827 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-f6748556-544f-4e8a-98e7-93b8dc6a7da4 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 9d761bfd-506d-431d-8b35-44697bcdb58a] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:05:16.782259 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f6748556-544f-4e8a-98e7-93b8dc6a7da4 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:05:16.782736 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f6748556-544f-4e8a-98e7-93b8dc6a7da4 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:05:16.783168 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f6748556-544f-4e8a-98e7-93b8dc6a7da4 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:05:16.783893 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f6748556-544f-4e8a-98e7-93b8dc6a7da4 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:05:16.784332 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f6748556-544f-4e8a-98e7-93b8dc6a7da4 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:05:16.784781 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f6748556-544f-4e8a-98e7-93b8dc6a7da4 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:05:16.848218 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-f6748556-544f-4e8a-98e7-93b8dc6a7da4 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1947f5ce1d794f05ae6272e8dba5d29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3218048072f048d9afc65ae138523bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:05:16.858163 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-f6748556-544f-4e8a-98e7-93b8dc6a7da4 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a" status: 200 len: 1289 microversion: 2.1 time: 0.087002 Sep 20 05:05:16.859443 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 680/830] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:05:16 2022] GET /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a => generated 1289 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:05:17.887410 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-08f97043-06b5-4b56-a93f-29fa0207e73d tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:05:17.888171 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-08f97043-06b5-4b56-a93f-29fa0207e73d tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 9d761bfd-506d-431d-8b35-44697bcdb58a] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:05:17.895939 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-08f97043-06b5-4b56-a93f-29fa0207e73d tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:05:17.896427 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-08f97043-06b5-4b56-a93f-29fa0207e73d tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:05:17.896892 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-08f97043-06b5-4b56-a93f-29fa0207e73d tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:05:17.897594 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-08f97043-06b5-4b56-a93f-29fa0207e73d tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:05:17.898052 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-08f97043-06b5-4b56-a93f-29fa0207e73d tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:05:17.898617 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-08f97043-06b5-4b56-a93f-29fa0207e73d tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:05:18.030524 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-08f97043-06b5-4b56-a93f-29fa0207e73d tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1947f5ce1d794f05ae6272e8dba5d29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3218048072f048d9afc65ae138523bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:05:18.038237 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-08f97043-06b5-4b56-a93f-29fa0207e73d tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a" status: 200 len: 1363 microversion: 2.1 time: 0.154836 Sep 20 05:05:18.038809 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 681/831] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:05:17 2022] GET /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 05:05:18.383076 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-438dc7b7-d890-4fa5-aec4-198f65e6f372 req-02ce7383-1584-4ba0-a37c-0293ac983217 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d761bfd-506d-431d-8b35-44697bcdb58a", "tag": "5311bcd4-9eaa-4ae8-a52e-b337c7ac8b35"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:05:18.395263 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-438dc7b7-d890-4fa5-aec4-198f65e6f372 req-02ce7383-1584-4ba0-a37c-0293ac983217 service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:05:18.395747 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-438dc7b7-d890-4fa5-aec4-198f65e6f372 req-02ce7383-1584-4ba0-a37c-0293ac983217 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:05:18.396178 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-438dc7b7-d890-4fa5-aec4-198f65e6f372 req-02ce7383-1584-4ba0-a37c-0293ac983217 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:05:18.408280 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-438dc7b7-d890-4fa5-aec4-198f65e6f372 req-02ce7383-1584-4ba0-a37c-0293ac983217 service nova] Creating event network-changed:5311bcd4-9eaa-4ae8-a52e-b337c7ac8b35 for instance 9d761bfd-506d-431d-8b35-44697bcdb58a on hv-cinder-75671 Sep 20 05:05:18.413850 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-438dc7b7-d890-4fa5-aec4-198f65e6f372 req-02ce7383-1584-4ba0-a37c-0293ac983217 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034472 Sep 20 05:05:18.415587 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 682/832] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 05:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 05:05:19.062079 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-b1ce32b8-507a-4d15-a441-3421ea08ae21 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:05:19.062777 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-b1ce32b8-507a-4d15-a441-3421ea08ae21 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 9d761bfd-506d-431d-8b35-44697bcdb58a] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:05:19.069525 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b1ce32b8-507a-4d15-a441-3421ea08ae21 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:05:19.070005 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b1ce32b8-507a-4d15-a441-3421ea08ae21 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:05:19.070444 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b1ce32b8-507a-4d15-a441-3421ea08ae21 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:05:19.071162 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b1ce32b8-507a-4d15-a441-3421ea08ae21 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:05:19.071615 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b1ce32b8-507a-4d15-a441-3421ea08ae21 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:05:19.072074 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b1ce32b8-507a-4d15-a441-3421ea08ae21 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:05:19.202315 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-b1ce32b8-507a-4d15-a441-3421ea08ae21 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1947f5ce1d794f05ae6272e8dba5d29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3218048072f048d9afc65ae138523bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:05:19.210011 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-b1ce32b8-507a-4d15-a441-3421ea08ae21 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a" status: 200 len: 1363 microversion: 2.1 time: 0.152186 Sep 20 05:05:19.210577 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 683/833] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:05:19 2022] GET /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:05:20.233769 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-50facf9c-3638-4d4c-9942-50372ea710a4 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:05:20.234433 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-50facf9c-3638-4d4c-9942-50372ea710a4 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 9d761bfd-506d-431d-8b35-44697bcdb58a] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:05:20.241055 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-50facf9c-3638-4d4c-9942-50372ea710a4 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:05:20.241537 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-50facf9c-3638-4d4c-9942-50372ea710a4 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:05:20.241970 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-50facf9c-3638-4d4c-9942-50372ea710a4 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:05:20.242659 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-50facf9c-3638-4d4c-9942-50372ea710a4 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:05:20.243769 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-50facf9c-3638-4d4c-9942-50372ea710a4 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:05:20.244194 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-50facf9c-3638-4d4c-9942-50372ea710a4 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:05:20.371851 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-50facf9c-3638-4d4c-9942-50372ea710a4 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1947f5ce1d794f05ae6272e8dba5d29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3218048072f048d9afc65ae138523bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:05:20.379427 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-50facf9c-3638-4d4c-9942-50372ea710a4 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a" status: 200 len: 1363 microversion: 2.1 time: 0.149576 Sep 20 05:05:20.379982 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 684/834] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:05:20 2022] GET /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:05:21.402316 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-8459528a-064c-4da5-b657-0488bd192df8 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:05:21.403030 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-8459528a-064c-4da5-b657-0488bd192df8 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 9d761bfd-506d-431d-8b35-44697bcdb58a] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:05:21.409462 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8459528a-064c-4da5-b657-0488bd192df8 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:05:21.409891 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8459528a-064c-4da5-b657-0488bd192df8 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:05:21.410317 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8459528a-064c-4da5-b657-0488bd192df8 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:05:21.410994 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8459528a-064c-4da5-b657-0488bd192df8 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:05:21.411438 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8459528a-064c-4da5-b657-0488bd192df8 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:05:21.411861 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8459528a-064c-4da5-b657-0488bd192df8 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:05:21.538177 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-8459528a-064c-4da5-b657-0488bd192df8 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1947f5ce1d794f05ae6272e8dba5d29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3218048072f048d9afc65ae138523bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:05:21.546278 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-8459528a-064c-4da5-b657-0488bd192df8 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a" status: 200 len: 1363 microversion: 2.1 time: 0.147945 Sep 20 05:05:21.546833 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 685/835] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:05:21 2022] GET /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:05:22.569356 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-4e817dcb-5cb2-4a54-814b-f71ae4c1f1f4 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:05:22.570000 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-4e817dcb-5cb2-4a54-814b-f71ae4c1f1f4 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 9d761bfd-506d-431d-8b35-44697bcdb58a] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:05:22.576961 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4e817dcb-5cb2-4a54-814b-f71ae4c1f1f4 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:05:22.577436 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4e817dcb-5cb2-4a54-814b-f71ae4c1f1f4 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:05:22.577921 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4e817dcb-5cb2-4a54-814b-f71ae4c1f1f4 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:05:22.578597 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4e817dcb-5cb2-4a54-814b-f71ae4c1f1f4 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:05:22.579043 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4e817dcb-5cb2-4a54-814b-f71ae4c1f1f4 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:05:22.579461 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4e817dcb-5cb2-4a54-814b-f71ae4c1f1f4 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:05:22.707948 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-4e817dcb-5cb2-4a54-814b-f71ae4c1f1f4 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1947f5ce1d794f05ae6272e8dba5d29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3218048072f048d9afc65ae138523bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:05:22.715682 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-4e817dcb-5cb2-4a54-814b-f71ae4c1f1f4 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a" status: 200 len: 1363 microversion: 2.1 time: 0.150168 Sep 20 05:05:22.716251 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 686/836] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:05:22 2022] GET /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:05:23.737360 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-4302d7a0-51ca-4990-ae42-1d7579197241 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:05:23.738069 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-4302d7a0-51ca-4990-ae42-1d7579197241 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 9d761bfd-506d-431d-8b35-44697bcdb58a] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:05:23.744467 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4302d7a0-51ca-4990-ae42-1d7579197241 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:05:23.744980 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4302d7a0-51ca-4990-ae42-1d7579197241 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:05:23.745425 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4302d7a0-51ca-4990-ae42-1d7579197241 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:05:23.746119 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4302d7a0-51ca-4990-ae42-1d7579197241 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:05:23.746572 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4302d7a0-51ca-4990-ae42-1d7579197241 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:05:23.747006 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4302d7a0-51ca-4990-ae42-1d7579197241 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:05:23.873053 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-4302d7a0-51ca-4990-ae42-1d7579197241 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1947f5ce1d794f05ae6272e8dba5d29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3218048072f048d9afc65ae138523bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:05:23.880680 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-4302d7a0-51ca-4990-ae42-1d7579197241 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a" status: 200 len: 1363 microversion: 2.1 time: 0.147186 Sep 20 05:05:23.881247 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 687/837] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:05:23 2022] GET /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:05:24.470698 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-d56db6ac-e0a7-48cf-95fe-96ba2c02d3e0 req-f5add355-d249-4201-9ec2-cdca2c966cd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d761bfd-506d-431d-8b35-44697bcdb58a", "name": "network-vif-plugged", "status": "completed", "tag": "5311bcd4-9eaa-4ae8-a52e-b337c7ac8b35"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:05:24.481207 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-d56db6ac-e0a7-48cf-95fe-96ba2c02d3e0 req-f5add355-d249-4201-9ec2-cdca2c966cd8 service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:05:24.481893 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-d56db6ac-e0a7-48cf-95fe-96ba2c02d3e0 req-f5add355-d249-4201-9ec2-cdca2c966cd8 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:05:24.482342 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-d56db6ac-e0a7-48cf-95fe-96ba2c02d3e0 req-f5add355-d249-4201-9ec2-cdca2c966cd8 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:05:24.494017 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-d56db6ac-e0a7-48cf-95fe-96ba2c02d3e0 req-f5add355-d249-4201-9ec2-cdca2c966cd8 service nova] Creating event network-vif-plugged:5311bcd4-9eaa-4ae8-a52e-b337c7ac8b35 for instance 9d761bfd-506d-431d-8b35-44697bcdb58a on hv-cinder-75671 Sep 20 05:05:24.498801 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-d56db6ac-e0a7-48cf-95fe-96ba2c02d3e0 req-f5add355-d249-4201-9ec2-cdca2c966cd8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031758 Sep 20 05:05:24.499393 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 688/838] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 05:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 05:05:24.904929 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-bed0976f-4c84-4e2f-9d9f-27162b176439 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:05:24.905639 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-bed0976f-4c84-4e2f-9d9f-27162b176439 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 9d761bfd-506d-431d-8b35-44697bcdb58a] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:05:24.911732 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-bed0976f-4c84-4e2f-9d9f-27162b176439 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:05:24.912211 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-bed0976f-4c84-4e2f-9d9f-27162b176439 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:05:24.912669 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-bed0976f-4c84-4e2f-9d9f-27162b176439 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:05:24.913349 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-bed0976f-4c84-4e2f-9d9f-27162b176439 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:05:24.913800 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-bed0976f-4c84-4e2f-9d9f-27162b176439 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:05:24.914250 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-bed0976f-4c84-4e2f-9d9f-27162b176439 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:05:25.044681 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-bed0976f-4c84-4e2f-9d9f-27162b176439 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1947f5ce1d794f05ae6272e8dba5d29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3218048072f048d9afc65ae138523bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:05:25.052296 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-bed0976f-4c84-4e2f-9d9f-27162b176439 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a" status: 200 len: 1363 microversion: 2.1 time: 0.152027 Sep 20 05:05:25.052892 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 689/839] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:05:24 2022] GET /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:05:26.075219 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-e71b1284-cd18-4b0a-a8e0-f46cd55dde5d tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:05:26.075806 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-e71b1284-cd18-4b0a-a8e0-f46cd55dde5d tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 9d761bfd-506d-431d-8b35-44697bcdb58a] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:05:26.077796 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell0:SELECT=2 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:05:26.078460 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell0:SELECT=12 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:05:26.084708 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e71b1284-cd18-4b0a-a8e0-f46cd55dde5d tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:05:26.085192 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e71b1284-cd18-4b0a-a8e0-f46cd55dde5d tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:05:26.085622 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e71b1284-cd18-4b0a-a8e0-f46cd55dde5d tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:05:26.086307 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e71b1284-cd18-4b0a-a8e0-f46cd55dde5d tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:05:26.086761 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e71b1284-cd18-4b0a-a8e0-f46cd55dde5d tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:05:26.087183 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e71b1284-cd18-4b0a-a8e0-f46cd55dde5d tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:05:26.091294 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:05:26.215645 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-e71b1284-cd18-4b0a-a8e0-f46cd55dde5d tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1947f5ce1d794f05ae6272e8dba5d29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3218048072f048d9afc65ae138523bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:05:26.223324 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-e71b1284-cd18-4b0a-a8e0-f46cd55dde5d tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a" status: 200 len: 1550 microversion: 2.1 time: 0.152007 Sep 20 05:05:26.223876 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 690/840] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:05:26 2022] GET /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a => generated 1550 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:05:26.246019 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-de579f36-380b-4a50-ae94-625392f0752c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:05:26.246509 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-de579f36-380b-4a50-ae94-625392f0752c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 9d761bfd-506d-431d-8b35-44697bcdb58a] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:05:26.252182 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-de579f36-380b-4a50-ae94-625392f0752c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:05:26.252690 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-de579f36-380b-4a50-ae94-625392f0752c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:05:26.253130 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-de579f36-380b-4a50-ae94-625392f0752c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:05:26.253815 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-de579f36-380b-4a50-ae94-625392f0752c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:05:26.254266 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-de579f36-380b-4a50-ae94-625392f0752c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:05:26.254688 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-de579f36-380b-4a50-ae94-625392f0752c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:05:26.334184 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-de579f36-380b-4a50-ae94-625392f0752c tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092331 Sep 20 05:05:26.334774 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 691/841] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Sep 20 05:05:26 2022] GET /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 05:05:27.252521 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-a85041c4-e8fd-4fd0-9f4d-de62a8278b46 req-55fd401a-f42f-4198-86ed-5aaf7a20d106 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d761bfd-506d-431d-8b35-44697bcdb58a", "tag": "5311bcd4-9eaa-4ae8-a52e-b337c7ac8b35"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:05:27.261829 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-a85041c4-e8fd-4fd0-9f4d-de62a8278b46 req-55fd401a-f42f-4198-86ed-5aaf7a20d106 service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:05:27.262330 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-a85041c4-e8fd-4fd0-9f4d-de62a8278b46 req-55fd401a-f42f-4198-86ed-5aaf7a20d106 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:05:27.262761 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-a85041c4-e8fd-4fd0-9f4d-de62a8278b46 req-55fd401a-f42f-4198-86ed-5aaf7a20d106 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:05:27.274555 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-a85041c4-e8fd-4fd0-9f4d-de62a8278b46 req-55fd401a-f42f-4198-86ed-5aaf7a20d106 service nova] Creating event network-changed:5311bcd4-9eaa-4ae8-a52e-b337c7ac8b35 for instance 9d761bfd-506d-431d-8b35-44697bcdb58a on hv-cinder-75671 Sep 20 05:05:27.279565 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-a85041c4-e8fd-4fd0-9f4d-de62a8278b46 req-55fd401a-f42f-4198-86ed-5aaf7a20d106 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031148 Sep 20 05:05:27.280345 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 692/842] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 05:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 05:06:03.539634 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:06:03.540389 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell1:SELECT=10 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:06:03.544991 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-ed2af379-818a-45de-b141-22d0521ea540 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:06:03.545564 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-ed2af379-818a-45de-b141-22d0521ea540 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 9d761bfd-506d-431d-8b35-44697bcdb58a] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:06:03.552910 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ed2af379-818a-45de-b141-22d0521ea540 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:03.553388 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ed2af379-818a-45de-b141-22d0521ea540 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:03.553816 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ed2af379-818a-45de-b141-22d0521ea540 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:03.554491 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ed2af379-818a-45de-b141-22d0521ea540 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:03.554934 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ed2af379-818a-45de-b141-22d0521ea540 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:03.555351 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ed2af379-818a-45de-b141-22d0521ea540 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:03.579749 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-ed2af379-818a-45de-b141-22d0521ea540 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a/ips" status: 200 len: 146 microversion: 2.1 time: 0.041921 Sep 20 05:06:03.580304 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 693/843] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Sep 20 05:06:03 2022] GET /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a/ips => generated 146 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 05:06:04.903094 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-7d52f7f0-e7cd-4ee5-8d22-b913070b13a3 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e868779f-e4a8-483d-8971-29ed6a5144d8"}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:06:04.905451 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-7d52f7f0-e7cd-4ee5-8d22-b913070b13a3 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 9d761bfd-506d-431d-8b35-44697bcdb58a] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:06:04.911862 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7d52f7f0-e7cd-4ee5-8d22-b913070b13a3 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:04.912340 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7d52f7f0-e7cd-4ee5-8d22-b913070b13a3 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:04.912813 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7d52f7f0-e7cd-4ee5-8d22-b913070b13a3 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:04.913501 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7d52f7f0-e7cd-4ee5-8d22-b913070b13a3 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:04.913957 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7d52f7f0-e7cd-4ee5-8d22-b913070b13a3 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:04.914384 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7d52f7f0-e7cd-4ee5-8d22-b913070b13a3 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:05.165218 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-7d52f7f0-e7cd-4ee5-8d22-b913070b13a3 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "POST /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265869 Sep 20 05:06:05.165826 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 694/844] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Sep 20 05:06:04 2022] POST /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 05:06:12.695733 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-f4d3997d-2a4a-4e82-a484-f7ba1e973340 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:06:12.698086 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-f4d3997d-2a4a-4e82-a484-f7ba1e973340 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 9d761bfd-506d-431d-8b35-44697bcdb58a] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:06:12.704860 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f4d3997d-2a4a-4e82-a484-f7ba1e973340 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:12.705344 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f4d3997d-2a4a-4e82-a484-f7ba1e973340 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:12.705787 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f4d3997d-2a4a-4e82-a484-f7ba1e973340 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:12.706477 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f4d3997d-2a4a-4e82-a484-f7ba1e973340 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:12.706935 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f4d3997d-2a4a-4e82-a484-f7ba1e973340 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:12.707369 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f4d3997d-2a4a-4e82-a484-f7ba1e973340 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:12.736987 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-f4d3997d-2a4a-4e82-a484-f7ba1e973340 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045995 Sep 20 05:06:12.737532 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 695/845] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Sep 20 05:06:12 2022] GET /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 05:06:12.748012 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-7c505309-5434-4d32-997f-7464f23dd5eb tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:06:12.748502 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-7c505309-5434-4d32-997f-7464f23dd5eb tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 9d761bfd-506d-431d-8b35-44697bcdb58a] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:06:12.754432 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7c505309-5434-4d32-997f-7464f23dd5eb tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:12.754919 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7c505309-5434-4d32-997f-7464f23dd5eb tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:12.755361 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7c505309-5434-4d32-997f-7464f23dd5eb tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:12.756052 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7c505309-5434-4d32-997f-7464f23dd5eb tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:12.756505 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7c505309-5434-4d32-997f-7464f23dd5eb tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:12.756959 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7c505309-5434-4d32-997f-7464f23dd5eb tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:12.785676 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-7c505309-5434-4d32-997f-7464f23dd5eb tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a/os-volume_attachments/e868779f-e4a8-483d-8971-29ed6a5144d8" status: 200 len: 194 microversion: 2.1 time: 0.041726 Sep 20 05:06:12.786256 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 696/846] 10.222.0.27 () {58 vars in 1413 bytes} [Tue Sep 20 05:06:12 2022] GET /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a/os-volume_attachments/e868779f-e4a8-483d-8971-29ed6a5144d8 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 05:06:14.132369 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-70519739-ae8f-4781-8b64-35c2f45a7080 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ad5f4975-539a-4232-909b-5955b2d33085"}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:06:14.134761 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-70519739-ae8f-4781-8b64-35c2f45a7080 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 9d761bfd-506d-431d-8b35-44697bcdb58a] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:06:14.141780 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-70519739-ae8f-4781-8b64-35c2f45a7080 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:14.142261 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-70519739-ae8f-4781-8b64-35c2f45a7080 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:14.142767 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-70519739-ae8f-4781-8b64-35c2f45a7080 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:14.143729 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-70519739-ae8f-4781-8b64-35c2f45a7080 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:14.144183 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-70519739-ae8f-4781-8b64-35c2f45a7080 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:14.144689 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-70519739-ae8f-4781-8b64-35c2f45a7080 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:14.399945 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-70519739-ae8f-4781-8b64-35c2f45a7080 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "POST /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271389 Sep 20 05:06:14.400545 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 697/847] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Sep 20 05:06:14 2022] POST /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 05:06:21.928017 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-c82e2236-2c45-43d6-9e6d-3636a2fc3ab7 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:06:21.929994 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-c82e2236-2c45-43d6-9e6d-3636a2fc3ab7 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 9d761bfd-506d-431d-8b35-44697bcdb58a] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:06:21.937974 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c82e2236-2c45-43d6-9e6d-3636a2fc3ab7 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:21.938459 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c82e2236-2c45-43d6-9e6d-3636a2fc3ab7 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:21.938896 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c82e2236-2c45-43d6-9e6d-3636a2fc3ab7 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:21.939595 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c82e2236-2c45-43d6-9e6d-3636a2fc3ab7 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:21.940052 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c82e2236-2c45-43d6-9e6d-3636a2fc3ab7 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:21.940515 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c82e2236-2c45-43d6-9e6d-3636a2fc3ab7 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:21.974328 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-c82e2236-2c45-43d6-9e6d-3636a2fc3ab7 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051441 Sep 20 05:06:21.974897 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 698/848] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Sep 20 05:06:21 2022] GET /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 05:06:22.115619 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-2f31c09f-54da-4d0b-b6b4-37967233753e tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:06:22.116105 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-2f31c09f-54da-4d0b-b6b4-37967233753e tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 9d761bfd-506d-431d-8b35-44697bcdb58a] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:06:22.123090 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2f31c09f-54da-4d0b-b6b4-37967233753e tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:22.123565 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2f31c09f-54da-4d0b-b6b4-37967233753e tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:22.123998 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2f31c09f-54da-4d0b-b6b4-37967233753e tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:22.124710 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2f31c09f-54da-4d0b-b6b4-37967233753e tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:22.125157 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2f31c09f-54da-4d0b-b6b4-37967233753e tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:22.125582 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2f31c09f-54da-4d0b-b6b4-37967233753e tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:22.155280 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-2f31c09f-54da-4d0b-b6b4-37967233753e tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a/os-volume_attachments/e868779f-e4a8-483d-8971-29ed6a5144d8" status: 200 len: 194 microversion: 2.1 time: 0.043441 Sep 20 05:06:22.155904 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 699/849] 10.222.0.27 () {58 vars in 1413 bytes} [Tue Sep 20 05:06:22 2022] GET /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a/os-volume_attachments/e868779f-e4a8-483d-8971-29ed6a5144d8 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 05:06:22.165740 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-dd7bcf5a-b4fa-4976-81e3-889e44282bf9 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:06:22.166231 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-dd7bcf5a-b4fa-4976-81e3-889e44282bf9 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 9d761bfd-506d-431d-8b35-44697bcdb58a] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:06:22.172412 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-dd7bcf5a-b4fa-4976-81e3-889e44282bf9 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:22.172926 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-dd7bcf5a-b4fa-4976-81e3-889e44282bf9 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:22.173364 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-dd7bcf5a-b4fa-4976-81e3-889e44282bf9 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:22.174049 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-dd7bcf5a-b4fa-4976-81e3-889e44282bf9 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:22.174521 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-dd7bcf5a-b4fa-4976-81e3-889e44282bf9 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:22.174932 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-dd7bcf5a-b4fa-4976-81e3-889e44282bf9 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:22.258740 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.objects.instance [None req-dd7bcf5a-b4fa-4976-81e3-889e44282bf9 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lazy-loading 'services' on Instance uuid 9d761bfd-506d-431d-8b35-44697bcdb58a {{(pid=126813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 05:06:22.327778 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-dd7bcf5a-b4fa-4976-81e3-889e44282bf9 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a/os-volume_attachments/e868779f-e4a8-483d-8971-29ed6a5144d8" status: 202 len: 0 microversion: 2.1 time: 0.165506 Sep 20 05:06:22.328423 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 700/850] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Sep 20 05:06:22 2022] DELETE /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a/os-volume_attachments/e868779f-e4a8-483d-8971-29ed6a5144d8 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 20 05:06:23.450756 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-885be045-2dac-436f-b579-8c9ca4f0c6d1 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:06:23.451370 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-885be045-2dac-436f-b579-8c9ca4f0c6d1 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 9d761bfd-506d-431d-8b35-44697bcdb58a] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:06:23.457464 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-885be045-2dac-436f-b579-8c9ca4f0c6d1 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:23.457938 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-885be045-2dac-436f-b579-8c9ca4f0c6d1 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:23.458369 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-885be045-2dac-436f-b579-8c9ca4f0c6d1 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:23.459044 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-885be045-2dac-436f-b579-8c9ca4f0c6d1 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:23.459487 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-885be045-2dac-436f-b579-8c9ca4f0c6d1 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:23.459907 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-885be045-2dac-436f-b579-8c9ca4f0c6d1 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:23.487716 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-885be045-2dac-436f-b579-8c9ca4f0c6d1 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a/os-volume_attachments/ad5f4975-539a-4232-909b-5955b2d33085" status: 200 len: 194 microversion: 2.1 time: 0.042459 Sep 20 05:06:23.488296 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 701/851] 10.222.0.27 () {58 vars in 1413 bytes} [Tue Sep 20 05:06:23 2022] GET /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a/os-volume_attachments/ad5f4975-539a-4232-909b-5955b2d33085 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 05:06:23.498447 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-399b20e4-f7dd-4a1b-9603-a7d611b47676 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:06:23.498928 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-399b20e4-f7dd-4a1b-9603-a7d611b47676 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 9d761bfd-506d-431d-8b35-44697bcdb58a] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:06:23.504481 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-399b20e4-f7dd-4a1b-9603-a7d611b47676 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:23.504988 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-399b20e4-f7dd-4a1b-9603-a7d611b47676 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:23.505422 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-399b20e4-f7dd-4a1b-9603-a7d611b47676 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:23.506094 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-399b20e4-f7dd-4a1b-9603-a7d611b47676 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:23.506540 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-399b20e4-f7dd-4a1b-9603-a7d611b47676 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:23.506959 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-399b20e4-f7dd-4a1b-9603-a7d611b47676 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:23.585081 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.objects.instance [None req-399b20e4-f7dd-4a1b-9603-a7d611b47676 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lazy-loading 'services' on Instance uuid 9d761bfd-506d-431d-8b35-44697bcdb58a {{(pid=126813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 05:06:23.654310 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-399b20e4-f7dd-4a1b-9603-a7d611b47676 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a/os-volume_attachments/ad5f4975-539a-4232-909b-5955b2d33085" status: 202 len: 0 microversion: 2.1 time: 0.159392 Sep 20 05:06:23.654851 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 702/852] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Sep 20 05:06:23 2022] DELETE /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a/os-volume_attachments/ad5f4975-539a-4232-909b-5955b2d33085 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 20 05:06:24.824475 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-66d2f8df-68e9-4083-9d81-f27c4a9958d7 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:06:24.826811 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-66d2f8df-68e9-4083-9d81-f27c4a9958d7 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 9d761bfd-506d-431d-8b35-44697bcdb58a] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:06:24.833505 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-66d2f8df-68e9-4083-9d81-f27c4a9958d7 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:24.833978 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-66d2f8df-68e9-4083-9d81-f27c4a9958d7 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:24.834407 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-66d2f8df-68e9-4083-9d81-f27c4a9958d7 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:24.835087 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-66d2f8df-68e9-4083-9d81-f27c4a9958d7 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:24.835533 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-66d2f8df-68e9-4083-9d81-f27c4a9958d7 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:24.835949 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-66d2f8df-68e9-4083-9d81-f27c4a9958d7 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:24.866081 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-66d2f8df-68e9-4083-9d81-f27c4a9958d7 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046414 Sep 20 05:06:24.866629 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 703/853] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Sep 20 05:06:24 2022] GET /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 20 05:06:24.980855 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-5643b19a-5ae7-41ad-9eec-ad278912d9f2 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:06:24.982998 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-5643b19a-5ae7-41ad-9eec-ad278912d9f2 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 9d761bfd-506d-431d-8b35-44697bcdb58a] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:06:24.988920 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5643b19a-5ae7-41ad-9eec-ad278912d9f2 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:24.989392 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5643b19a-5ae7-41ad-9eec-ad278912d9f2 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:24.989828 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5643b19a-5ae7-41ad-9eec-ad278912d9f2 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:24.990505 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5643b19a-5ae7-41ad-9eec-ad278912d9f2 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:24.990947 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5643b19a-5ae7-41ad-9eec-ad278912d9f2 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:24.991363 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-5643b19a-5ae7-41ad-9eec-ad278912d9f2 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:25.021413 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-5643b19a-5ae7-41ad-9eec-ad278912d9f2 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044551 Sep 20 05:06:25.021960 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 704/854] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Sep 20 05:06:24 2022] GET /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 20 05:06:25.083236 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-26a4acdf-b1ef-44dc-89b0-45080fa27c6d tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:06:25.083749 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-26a4acdf-b1ef-44dc-89b0-45080fa27c6d tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 9d761bfd-506d-431d-8b35-44697bcdb58a] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:06:25.089678 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-26a4acdf-b1ef-44dc-89b0-45080fa27c6d tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:25.090155 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-26a4acdf-b1ef-44dc-89b0-45080fa27c6d tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:25.090591 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-26a4acdf-b1ef-44dc-89b0-45080fa27c6d tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:25.091270 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-26a4acdf-b1ef-44dc-89b0-45080fa27c6d tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:25.091719 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-26a4acdf-b1ef-44dc-89b0-45080fa27c6d tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:25.092134 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-26a4acdf-b1ef-44dc-89b0-45080fa27c6d tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:25.116955 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-26a4acdf-b1ef-44dc-89b0-45080fa27c6d tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 9d761bfd-506d-431d-8b35-44697bcdb58a] Going to try to terminate instance {{(pid=126813) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 20 05:06:25.119675 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:06:25.196107 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-26a4acdf-b1ef-44dc-89b0-45080fa27c6d tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a" status: 204 len: 0 microversion: 2.1 time: 0.116430 Sep 20 05:06:25.196719 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 705/855] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Sep 20 05:06:25 2022] DELETE /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 20 05:06:25.205154 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-eca39b68-7cf9-4f84-aa75-68f9ed3678ab tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:06:25.205848 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-eca39b68-7cf9-4f84-aa75-68f9ed3678ab tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 9d761bfd-506d-431d-8b35-44697bcdb58a] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:06:25.211536 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-eca39b68-7cf9-4f84-aa75-68f9ed3678ab tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:25.212019 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-eca39b68-7cf9-4f84-aa75-68f9ed3678ab tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:25.212454 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-eca39b68-7cf9-4f84-aa75-68f9ed3678ab tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:25.213169 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-eca39b68-7cf9-4f84-aa75-68f9ed3678ab tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:25.213620 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-eca39b68-7cf9-4f84-aa75-68f9ed3678ab tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:25.214043 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-eca39b68-7cf9-4f84-aa75-68f9ed3678ab tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:25.343506 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-eca39b68-7cf9-4f84-aa75-68f9ed3678ab tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1947f5ce1d794f05ae6272e8dba5d29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3218048072f048d9afc65ae138523bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:06:25.351184 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-eca39b68-7cf9-4f84-aa75-68f9ed3678ab tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a" status: 200 len: 1674 microversion: 2.1 time: 0.150075 Sep 20 05:06:25.351894 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 706/856] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:06:25 2022] GET /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:06:26.374931 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-e9537983-4894-4f43-a9ed-eb5ac4105edf tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:06:26.375592 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-e9537983-4894-4f43-a9ed-eb5ac4105edf tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 9d761bfd-506d-431d-8b35-44697bcdb58a] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:06:26.382006 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e9537983-4894-4f43-a9ed-eb5ac4105edf tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:26.382490 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e9537983-4894-4f43-a9ed-eb5ac4105edf tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:26.382933 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e9537983-4894-4f43-a9ed-eb5ac4105edf tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:26.383622 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e9537983-4894-4f43-a9ed-eb5ac4105edf tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:26.384076 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e9537983-4894-4f43-a9ed-eb5ac4105edf tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:26.384500 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e9537983-4894-4f43-a9ed-eb5ac4105edf tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:26.510208 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-e9537983-4894-4f43-a9ed-eb5ac4105edf tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1947f5ce1d794f05ae6272e8dba5d29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3218048072f048d9afc65ae138523bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:06:26.518385 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-e9537983-4894-4f43-a9ed-eb5ac4105edf tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a" status: 200 len: 1674 microversion: 2.1 time: 0.147812 Sep 20 05:06:26.519197 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 707/857] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:06:26 2022] GET /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a => generated 1674 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:06:27.541893 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-866667a7-22cd-402c-8e1a-ba84f7b8c42a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:06:27.543068 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-866667a7-22cd-402c-8e1a-ba84f7b8c42a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 9d761bfd-506d-431d-8b35-44697bcdb58a] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:06:27.549289 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-866667a7-22cd-402c-8e1a-ba84f7b8c42a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:27.549766 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-866667a7-22cd-402c-8e1a-ba84f7b8c42a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:27.550200 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-866667a7-22cd-402c-8e1a-ba84f7b8c42a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:27.550879 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-866667a7-22cd-402c-8e1a-ba84f7b8c42a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:27.551323 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-866667a7-22cd-402c-8e1a-ba84f7b8c42a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:27.551772 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-866667a7-22cd-402c-8e1a-ba84f7b8c42a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:27.677146 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-866667a7-22cd-402c-8e1a-ba84f7b8c42a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1947f5ce1d794f05ae6272e8dba5d29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3218048072f048d9afc65ae138523bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:06:27.685424 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-866667a7-22cd-402c-8e1a-ba84f7b8c42a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a" status: 200 len: 1674 microversion: 2.1 time: 0.147355 Sep 20 05:06:27.685982 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 708/858] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:06:27 2022] GET /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a => generated 1674 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:06:28.093926 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-eacde3c2-9463-4ab9-8b8a-c5b09cebcedd req-cef458da-7aa6-49b0-a874-1dc67d81d88d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d761bfd-506d-431d-8b35-44697bcdb58a", "name": "network-vif-deleted", "tag": "5311bcd4-9eaa-4ae8-a52e-b337c7ac8b35"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:06:28.103860 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-eacde3c2-9463-4ab9-8b8a-c5b09cebcedd req-cef458da-7aa6-49b0-a874-1dc67d81d88d service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:28.104357 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-eacde3c2-9463-4ab9-8b8a-c5b09cebcedd req-cef458da-7aa6-49b0-a874-1dc67d81d88d service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:28.104939 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-eacde3c2-9463-4ab9-8b8a-c5b09cebcedd req-cef458da-7aa6-49b0-a874-1dc67d81d88d service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:28.116229 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-eacde3c2-9463-4ab9-8b8a-c5b09cebcedd req-cef458da-7aa6-49b0-a874-1dc67d81d88d service nova] Creating event network-vif-deleted:5311bcd4-9eaa-4ae8-a52e-b337c7ac8b35 for instance 9d761bfd-506d-431d-8b35-44697bcdb58a on hv-cinder-75671 Sep 20 05:06:28.121205 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-eacde3c2-9463-4ab9-8b8a-c5b09cebcedd req-cef458da-7aa6-49b0-a874-1dc67d81d88d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031438 Sep 20 05:06:28.121819 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 709/859] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 05:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 05:06:28.710014 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-3e63994c-285b-4cd7-8341-d86223427a48 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:06:28.710777 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-3e63994c-285b-4cd7-8341-d86223427a48 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 9d761bfd-506d-431d-8b35-44697bcdb58a] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:06:28.718096 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3e63994c-285b-4cd7-8341-d86223427a48 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:28.718591 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3e63994c-285b-4cd7-8341-d86223427a48 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:28.719041 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3e63994c-285b-4cd7-8341-d86223427a48 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:28.719728 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3e63994c-285b-4cd7-8341-d86223427a48 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:28.720178 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3e63994c-285b-4cd7-8341-d86223427a48 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:28.720626 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3e63994c-285b-4cd7-8341-d86223427a48 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:28.734556 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.wsgi [None req-3e63994c-285b-4cd7-8341-d86223427a48 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] HTTP exception thrown: Instance 9d761bfd-506d-431d-8b35-44697bcdb58a could not be found. Sep 20 05:06:28.736186 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-3e63994c-285b-4cd7-8341-d86223427a48 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Request method failure captured: Sep 20 05:06:28.736186 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: request: GET /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a HTTP/1.1 Sep 20 05:06:28.736186 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept: application/json Sep 20 05:06:28.736186 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept-Encoding: identity Sep 20 05:06:28.736186 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Connection: close Sep 20 05:06:28.736186 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Length: 0 Sep 20 05:06:28.736186 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Type: application/json Sep 20 05:06:28.736186 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Host: 10.222.0.27 Sep 20 05:06:28.736186 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Openstack-System-Scope: None Sep 20 05:06:28.736186 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: User-Agent: python-urllib3/1.26.12 Sep 20 05:06:28.736186 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Auth-Token: gAAAAABjKUlxz9xxkTj8dm7Vm-I1IR7M6WZyKsnfLxXS8XrLfdbXZFHlewEX9Kqhk5nRbTsy0G2wqWNmc9u10aD6dqjwV2Gxk9D843PW3MsvZguhxpHed6vEIu4-xDvVwlfkOn_vX-pB9CKAqIgXJohltAUGYaDZFF5Hhihp8yy2_jOErOcQ3ck Sep 20 05:06:28.736186 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Id: None Sep 20 05:06:28.736186 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Name: None Sep 20 05:06:28.736186 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Identity-Status: Confirmed Sep 20 05:06:28.736186 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Is-Admin-Project: True Sep 20 05:06:28.736186 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Id: default Sep 20 05:06:28.736186 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Name: Default Sep 20 05:06:28.736186 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Id: 3218048072f048d9afc65ae138523bfd Sep 20 05:06:28.736186 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Name: tempest-AttachVolumeTestJSON-1068414702 Sep 20 05:06:28.736186 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Role: reader,member Sep 20 05:06:28.736186 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Roles: reader,member Sep 20 05:06:28.737814 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3218048072f048d9afc65ae138523bfd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3218048072f048d9afc65ae138523bfd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3218048072f048d9afc65ae138523bfd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3218048072f048d9afc65ae138523bfd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 05:06:28.737814 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant: tempest-AttachVolumeTestJSON-1068414702 Sep 20 05:06:28.737814 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Id: 3218048072f048d9afc65ae138523bfd Sep 20 05:06:28.737814 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1068414702 Sep 20 05:06:28.737814 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User: tempest-AttachVolumeTestJSON-1068414702-project Sep 20 05:06:28.737814 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Id: default Sep 20 05:06:28.737814 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Name: Default Sep 20 05:06:28.737814 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Id: 1947f5ce1d794f05ae6272e8dba5d29c Sep 20 05:06:28.737814 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Name: tempest-AttachVolumeTestJSON-1068414702-project Sep 20 05:06:28.737814 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: method: > Sep 20 05:06:28.737814 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: exception: Instance 9d761bfd-506d-431d-8b35-44697bcdb58a could not be found. Sep 20 05:06:28.737814 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: action_args: {'id': '9d761bfd-506d-431d-8b35-44697bcdb58a'} Sep 20 05:06:28.738649 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 05:06:28.738649 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:06:28.738649 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 05:06:28.738649 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 05:06:28.738649 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 05:06:28.738649 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 05:06:28.738649 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 05:06:28.738649 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 05:06:28.738649 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 05:06:28.738649 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 05:06:28.738649 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d761bfd-506d-431d-8b35-44697bcdb58a could not be found. Sep 20 05:06:28.738649 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:06:28.738649 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 05:06:28.738649 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:06:28.738649 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:06:28.738649 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 05:06:28.738649 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 05:06:28.738649 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 05:06:28.738649 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 05:06:28.738649 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 05:06:28.740118 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 05:06:28.740118 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 05:06:28.740118 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 05:06:28.740118 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 05:06:28.740118 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 05:06:28.740118 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 05:06:28.740118 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 05:06:28.740118 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d761bfd-506d-431d-8b35-44697bcdb58a could not be found. Sep 20 05:06:28.740118 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:06:28.740118 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 05:06:28.740118 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:06:28.740118 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:06:28.740118 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 05:06:28.740118 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 05:06:28.740118 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 05:06:28.740118 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 05:06:28.740118 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d761bfd-506d-431d-8b35-44697bcdb58a could not be found. Sep 20 05:06:28.740118 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:06:28.741399 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-3e63994c-285b-4cd7-8341-d86223427a48 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Returning 404 to user: Instance 9d761bfd-506d-431d-8b35-44697bcdb58a could not be found. {{(pid=126813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 05:06:28.741399 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-3e63994c-285b-4cd7-8341-d86223427a48 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a" status: 404 len: 111 microversion: 2.1 time: 0.032290 Sep 20 05:06:28.741399 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 710/860] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:06:28 2022] GET /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 20 05:06:28.746184 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-eb9319a2-3e6b-43c4-8fdc-795f5858b8d9 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '.version_select at 0x7f2e4a447820>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:06:28.765753 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-eb9319a2-3e6b-43c4-8fdc-795f5858b8d9 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-246452007" status: 202 len: 0 microversion: 2.1 time: 0.023088 Sep 20 05:06:28.766343 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 711/861] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Sep 20 05:06:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-246452007 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 20 05:06:31.654028 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-15504a02-2b07-473e-b168-d6f8951d8d3a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:06:31.654600 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-15504a02-2b07-473e-b168-d6f8951d8d3a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 9d761bfd-506d-431d-8b35-44697bcdb58a] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:06:31.661188 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-15504a02-2b07-473e-b168-d6f8951d8d3a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:31.661672 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-15504a02-2b07-473e-b168-d6f8951d8d3a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:31.662110 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-15504a02-2b07-473e-b168-d6f8951d8d3a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:31.662795 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-15504a02-2b07-473e-b168-d6f8951d8d3a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:31.663253 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-15504a02-2b07-473e-b168-d6f8951d8d3a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:31.663680 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-15504a02-2b07-473e-b168-d6f8951d8d3a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:31.677583 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.wsgi [None req-15504a02-2b07-473e-b168-d6f8951d8d3a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] HTTP exception thrown: Instance 9d761bfd-506d-431d-8b35-44697bcdb58a could not be found. Sep 20 05:06:31.679110 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-15504a02-2b07-473e-b168-d6f8951d8d3a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Request method failure captured: Sep 20 05:06:31.679110 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: request: DELETE /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a HTTP/1.1 Sep 20 05:06:31.679110 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept: application/json Sep 20 05:06:31.679110 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept-Encoding: identity Sep 20 05:06:31.679110 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Connection: close Sep 20 05:06:31.679110 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Length: 0 Sep 20 05:06:31.679110 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Type: application/json Sep 20 05:06:31.679110 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Host: 10.222.0.27 Sep 20 05:06:31.679110 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Openstack-System-Scope: None Sep 20 05:06:31.679110 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: User-Agent: python-urllib3/1.26.12 Sep 20 05:06:31.679110 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Auth-Token: gAAAAABjKUlxz9xxkTj8dm7Vm-I1IR7M6WZyKsnfLxXS8XrLfdbXZFHlewEX9Kqhk5nRbTsy0G2wqWNmc9u10aD6dqjwV2Gxk9D843PW3MsvZguhxpHed6vEIu4-xDvVwlfkOn_vX-pB9CKAqIgXJohltAUGYaDZFF5Hhihp8yy2_jOErOcQ3ck Sep 20 05:06:31.679110 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Id: None Sep 20 05:06:31.679110 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Name: None Sep 20 05:06:31.679110 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Identity-Status: Confirmed Sep 20 05:06:31.679110 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Is-Admin-Project: True Sep 20 05:06:31.679110 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Id: default Sep 20 05:06:31.679110 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Name: Default Sep 20 05:06:31.679110 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Id: 3218048072f048d9afc65ae138523bfd Sep 20 05:06:31.679110 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Name: tempest-AttachVolumeTestJSON-1068414702 Sep 20 05:06:31.679110 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Role: reader,member Sep 20 05:06:31.679110 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Roles: reader,member Sep 20 05:06:31.680774 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3218048072f048d9afc65ae138523bfd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3218048072f048d9afc65ae138523bfd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3218048072f048d9afc65ae138523bfd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3218048072f048d9afc65ae138523bfd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 05:06:31.680774 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant: tempest-AttachVolumeTestJSON-1068414702 Sep 20 05:06:31.680774 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Id: 3218048072f048d9afc65ae138523bfd Sep 20 05:06:31.680774 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1068414702 Sep 20 05:06:31.680774 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User: tempest-AttachVolumeTestJSON-1068414702-project Sep 20 05:06:31.680774 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Id: default Sep 20 05:06:31.680774 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Name: Default Sep 20 05:06:31.680774 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Id: 1947f5ce1d794f05ae6272e8dba5d29c Sep 20 05:06:31.680774 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Name: tempest-AttachVolumeTestJSON-1068414702-project Sep 20 05:06:31.680774 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: method: > Sep 20 05:06:31.680774 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: exception: Instance 9d761bfd-506d-431d-8b35-44697bcdb58a could not be found. Sep 20 05:06:31.680774 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: action_args: {'id': '9d761bfd-506d-431d-8b35-44697bcdb58a'} Sep 20 05:06:31.681648 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 05:06:31.681648 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:06:31.681648 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 05:06:31.681648 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 05:06:31.681648 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 05:06:31.681648 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 05:06:31.681648 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 05:06:31.681648 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 05:06:31.681648 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 05:06:31.681648 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 05:06:31.681648 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d761bfd-506d-431d-8b35-44697bcdb58a could not be found. Sep 20 05:06:31.681648 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:06:31.681648 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 05:06:31.681648 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:06:31.681648 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:06:31.681648 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 05:06:31.681648 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 05:06:31.681648 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 05:06:31.681648 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 05:06:31.681648 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 05:06:31.683179 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 05:06:31.683179 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 20 05:06:31.683179 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 20 05:06:31.683179 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 20 05:06:31.683179 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 20 05:06:31.683179 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 05:06:31.683179 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 05:06:31.683179 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 05:06:31.683179 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 05:06:31.683179 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d761bfd-506d-431d-8b35-44697bcdb58a could not be found. Sep 20 05:06:31.683179 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:06:31.683179 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 05:06:31.683179 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:06:31.683179 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:06:31.683179 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 05:06:31.683179 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 05:06:31.683179 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 05:06:31.683179 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 05:06:31.683179 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d761bfd-506d-431d-8b35-44697bcdb58a could not be found. Sep 20 05:06:31.683179 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:06:31.685297 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-15504a02-2b07-473e-b168-d6f8951d8d3a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Returning 404 to user: Instance 9d761bfd-506d-431d-8b35-44697bcdb58a could not be found. {{(pid=126813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 05:06:31.685297 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-15504a02-2b07-473e-b168-d6f8951d8d3a tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a" status: 404 len: 111 microversion: 2.1 time: 0.031324 Sep 20 05:06:31.685297 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 712/862] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Sep 20 05:06:31 2022] DELETE /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 20 05:06:31.689516 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-c1c3ea62-e622-41c1-b07f-7addabc7d59b tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:06:31.690130 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-c1c3ea62-e622-41c1-b07f-7addabc7d59b tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 9d761bfd-506d-431d-8b35-44697bcdb58a] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:06:31.695767 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c1c3ea62-e622-41c1-b07f-7addabc7d59b tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:31.696246 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c1c3ea62-e622-41c1-b07f-7addabc7d59b tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:31.696709 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c1c3ea62-e622-41c1-b07f-7addabc7d59b tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:31.697398 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c1c3ea62-e622-41c1-b07f-7addabc7d59b tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:31.697850 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c1c3ea62-e622-41c1-b07f-7addabc7d59b tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:31.698275 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c1c3ea62-e622-41c1-b07f-7addabc7d59b tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:31.711301 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.wsgi [None req-c1c3ea62-e622-41c1-b07f-7addabc7d59b tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] HTTP exception thrown: Instance 9d761bfd-506d-431d-8b35-44697bcdb58a could not be found. Sep 20 05:06:31.712817 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-c1c3ea62-e622-41c1-b07f-7addabc7d59b tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Request method failure captured: Sep 20 05:06:31.712817 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: request: GET /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a HTTP/1.1 Sep 20 05:06:31.712817 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept: application/json Sep 20 05:06:31.712817 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept-Encoding: identity Sep 20 05:06:31.712817 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Connection: close Sep 20 05:06:31.712817 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Length: 0 Sep 20 05:06:31.712817 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Type: application/json Sep 20 05:06:31.712817 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Host: 10.222.0.27 Sep 20 05:06:31.712817 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Openstack-System-Scope: None Sep 20 05:06:31.712817 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: User-Agent: python-urllib3/1.26.12 Sep 20 05:06:31.712817 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Auth-Token: gAAAAABjKUlxz9xxkTj8dm7Vm-I1IR7M6WZyKsnfLxXS8XrLfdbXZFHlewEX9Kqhk5nRbTsy0G2wqWNmc9u10aD6dqjwV2Gxk9D843PW3MsvZguhxpHed6vEIu4-xDvVwlfkOn_vX-pB9CKAqIgXJohltAUGYaDZFF5Hhihp8yy2_jOErOcQ3ck Sep 20 05:06:31.712817 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Id: None Sep 20 05:06:31.712817 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Name: None Sep 20 05:06:31.712817 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Identity-Status: Confirmed Sep 20 05:06:31.712817 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Is-Admin-Project: True Sep 20 05:06:31.712817 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Id: default Sep 20 05:06:31.712817 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Name: Default Sep 20 05:06:31.712817 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Id: 3218048072f048d9afc65ae138523bfd Sep 20 05:06:31.712817 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Name: tempest-AttachVolumeTestJSON-1068414702 Sep 20 05:06:31.712817 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Role: reader,member Sep 20 05:06:31.712817 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Roles: reader,member Sep 20 05:06:31.714805 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3218048072f048d9afc65ae138523bfd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3218048072f048d9afc65ae138523bfd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3218048072f048d9afc65ae138523bfd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3218048072f048d9afc65ae138523bfd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 05:06:31.714805 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant: tempest-AttachVolumeTestJSON-1068414702 Sep 20 05:06:31.714805 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Id: 3218048072f048d9afc65ae138523bfd Sep 20 05:06:31.714805 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1068414702 Sep 20 05:06:31.714805 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User: tempest-AttachVolumeTestJSON-1068414702-project Sep 20 05:06:31.714805 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Id: default Sep 20 05:06:31.714805 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Name: Default Sep 20 05:06:31.714805 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Id: 1947f5ce1d794f05ae6272e8dba5d29c Sep 20 05:06:31.714805 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Name: tempest-AttachVolumeTestJSON-1068414702-project Sep 20 05:06:31.714805 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: method: > Sep 20 05:06:31.714805 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: exception: Instance 9d761bfd-506d-431d-8b35-44697bcdb58a could not be found. Sep 20 05:06:31.714805 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: action_args: {'id': '9d761bfd-506d-431d-8b35-44697bcdb58a'} Sep 20 05:06:31.715624 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 05:06:31.715624 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:06:31.715624 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 05:06:31.715624 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 05:06:31.715624 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 05:06:31.715624 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 05:06:31.715624 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 05:06:31.715624 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 05:06:31.715624 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 05:06:31.715624 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 05:06:31.715624 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d761bfd-506d-431d-8b35-44697bcdb58a could not be found. Sep 20 05:06:31.715624 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:06:31.715624 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 05:06:31.715624 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:06:31.715624 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:06:31.715624 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 05:06:31.715624 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 05:06:31.715624 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 05:06:31.715624 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 05:06:31.715624 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 05:06:31.717155 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 05:06:31.717155 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 05:06:31.717155 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 05:06:31.717155 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 05:06:31.717155 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 05:06:31.717155 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 05:06:31.717155 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 05:06:31.717155 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d761bfd-506d-431d-8b35-44697bcdb58a could not be found. Sep 20 05:06:31.717155 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:06:31.717155 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 05:06:31.717155 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:06:31.717155 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:06:31.717155 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 05:06:31.717155 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 05:06:31.717155 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 05:06:31.717155 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 05:06:31.717155 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d761bfd-506d-431d-8b35-44697bcdb58a could not be found. Sep 20 05:06:31.717155 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:06:31.718547 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-c1c3ea62-e622-41c1-b07f-7addabc7d59b tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Returning 404 to user: Instance 9d761bfd-506d-431d-8b35-44697bcdb58a could not be found. {{(pid=126813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 05:06:31.718547 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-c1c3ea62-e622-41c1-b07f-7addabc7d59b tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a" status: 404 len: 111 microversion: 2.1 time: 0.029173 Sep 20 05:06:31.718547 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 713/863] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:06:31 2022] GET /compute/v2.1/servers/9d761bfd-506d-431d-8b35-44697bcdb58a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 20 05:06:32.859978 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-f16cff0f-63aa-4942-a03a-8547911745f8 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:06:32.860562 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-f16cff0f-63aa-4942-a03a-8547911745f8 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 6a85f27c-bdfe-4580-8579-71ea2b71bbfd] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:06:32.866879 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f16cff0f-63aa-4942-a03a-8547911745f8 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:32.867354 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f16cff0f-63aa-4942-a03a-8547911745f8 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:32.867781 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f16cff0f-63aa-4942-a03a-8547911745f8 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:32.868467 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f16cff0f-63aa-4942-a03a-8547911745f8 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:32.868941 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f16cff0f-63aa-4942-a03a-8547911745f8 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:32.869361 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f16cff0f-63aa-4942-a03a-8547911745f8 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:32.883070 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.wsgi [None req-f16cff0f-63aa-4942-a03a-8547911745f8 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] HTTP exception thrown: Instance 6a85f27c-bdfe-4580-8579-71ea2b71bbfd could not be found. Sep 20 05:06:32.884586 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-f16cff0f-63aa-4942-a03a-8547911745f8 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Request method failure captured: Sep 20 05:06:32.884586 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: request: DELETE /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd HTTP/1.1 Sep 20 05:06:32.884586 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept: application/json Sep 20 05:06:32.884586 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept-Encoding: identity Sep 20 05:06:32.884586 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Connection: close Sep 20 05:06:32.884586 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Length: 0 Sep 20 05:06:32.884586 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Type: application/json Sep 20 05:06:32.884586 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Host: 10.222.0.27 Sep 20 05:06:32.884586 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Openstack-System-Scope: None Sep 20 05:06:32.884586 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: User-Agent: python-urllib3/1.26.12 Sep 20 05:06:32.884586 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Auth-Token: gAAAAABjKUlxz9xxkTj8dm7Vm-I1IR7M6WZyKsnfLxXS8XrLfdbXZFHlewEX9Kqhk5nRbTsy0G2wqWNmc9u10aD6dqjwV2Gxk9D843PW3MsvZguhxpHed6vEIu4-xDvVwlfkOn_vX-pB9CKAqIgXJohltAUGYaDZFF5Hhihp8yy2_jOErOcQ3ck Sep 20 05:06:32.884586 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Id: None Sep 20 05:06:32.884586 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Name: None Sep 20 05:06:32.884586 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Identity-Status: Confirmed Sep 20 05:06:32.884586 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Is-Admin-Project: True Sep 20 05:06:32.884586 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Id: default Sep 20 05:06:32.884586 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Name: Default Sep 20 05:06:32.884586 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Id: 3218048072f048d9afc65ae138523bfd Sep 20 05:06:32.884586 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Name: tempest-AttachVolumeTestJSON-1068414702 Sep 20 05:06:32.884586 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Role: reader,member Sep 20 05:06:32.884586 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Roles: reader,member Sep 20 05:06:32.886691 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3218048072f048d9afc65ae138523bfd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3218048072f048d9afc65ae138523bfd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3218048072f048d9afc65ae138523bfd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3218048072f048d9afc65ae138523bfd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 05:06:32.886691 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant: tempest-AttachVolumeTestJSON-1068414702 Sep 20 05:06:32.886691 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Id: 3218048072f048d9afc65ae138523bfd Sep 20 05:06:32.886691 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1068414702 Sep 20 05:06:32.886691 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User: tempest-AttachVolumeTestJSON-1068414702-project Sep 20 05:06:32.886691 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Id: default Sep 20 05:06:32.886691 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Name: Default Sep 20 05:06:32.886691 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Id: 1947f5ce1d794f05ae6272e8dba5d29c Sep 20 05:06:32.886691 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Name: tempest-AttachVolumeTestJSON-1068414702-project Sep 20 05:06:32.886691 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: method: > Sep 20 05:06:32.886691 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: exception: Instance 6a85f27c-bdfe-4580-8579-71ea2b71bbfd could not be found. Sep 20 05:06:32.886691 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: action_args: {'id': '6a85f27c-bdfe-4580-8579-71ea2b71bbfd'} Sep 20 05:06:32.887775 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 05:06:32.887775 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:06:32.887775 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 05:06:32.887775 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 05:06:32.887775 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 05:06:32.887775 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 05:06:32.887775 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 05:06:32.887775 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 05:06:32.887775 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 05:06:32.887775 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 05:06:32.887775 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a85f27c-bdfe-4580-8579-71ea2b71bbfd could not be found. Sep 20 05:06:32.887775 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:06:32.887775 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 05:06:32.887775 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:06:32.887775 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:06:32.887775 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 05:06:32.887775 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 05:06:32.887775 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 05:06:32.887775 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 05:06:32.887775 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 05:06:32.889281 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 05:06:32.889281 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 20 05:06:32.889281 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 20 05:06:32.889281 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 20 05:06:32.889281 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 20 05:06:32.889281 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 05:06:32.889281 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 05:06:32.889281 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 05:06:32.889281 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 05:06:32.889281 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a85f27c-bdfe-4580-8579-71ea2b71bbfd could not be found. Sep 20 05:06:32.889281 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:06:32.889281 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 05:06:32.889281 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:06:32.889281 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:06:32.889281 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 05:06:32.889281 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 05:06:32.889281 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 05:06:32.889281 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 05:06:32.889281 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a85f27c-bdfe-4580-8579-71ea2b71bbfd could not be found. Sep 20 05:06:32.889281 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:06:32.890819 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-f16cff0f-63aa-4942-a03a-8547911745f8 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Returning 404 to user: Instance 6a85f27c-bdfe-4580-8579-71ea2b71bbfd could not be found. {{(pid=126813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 05:06:32.890819 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-f16cff0f-63aa-4942-a03a-8547911745f8 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd" status: 404 len: 111 microversion: 2.1 time: 0.029814 Sep 20 05:06:32.890819 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 714/864] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Sep 20 05:06:32 2022] DELETE /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 20 05:06:32.894348 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-05740020-d89d-461f-8ddf-9dd771e26227 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:06:32.894941 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-05740020-d89d-461f-8ddf-9dd771e26227 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] [instance: 6a85f27c-bdfe-4580-8579-71ea2b71bbfd] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:06:32.900433 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-05740020-d89d-461f-8ddf-9dd771e26227 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:32.900946 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-05740020-d89d-461f-8ddf-9dd771e26227 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:32.901384 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-05740020-d89d-461f-8ddf-9dd771e26227 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:32.902664 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-05740020-d89d-461f-8ddf-9dd771e26227 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:32.903110 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-05740020-d89d-461f-8ddf-9dd771e26227 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:32.903527 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-05740020-d89d-461f-8ddf-9dd771e26227 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:32.916479 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.wsgi [None req-05740020-d89d-461f-8ddf-9dd771e26227 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] HTTP exception thrown: Instance 6a85f27c-bdfe-4580-8579-71ea2b71bbfd could not be found. Sep 20 05:06:32.918309 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-05740020-d89d-461f-8ddf-9dd771e26227 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Request method failure captured: Sep 20 05:06:32.918309 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: request: GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd HTTP/1.1 Sep 20 05:06:32.918309 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept: application/json Sep 20 05:06:32.918309 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept-Encoding: identity Sep 20 05:06:32.918309 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Connection: close Sep 20 05:06:32.918309 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Length: 0 Sep 20 05:06:32.918309 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Type: application/json Sep 20 05:06:32.918309 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Host: 10.222.0.27 Sep 20 05:06:32.918309 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Openstack-System-Scope: None Sep 20 05:06:32.918309 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: User-Agent: python-urllib3/1.26.12 Sep 20 05:06:32.918309 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Auth-Token: gAAAAABjKUlxz9xxkTj8dm7Vm-I1IR7M6WZyKsnfLxXS8XrLfdbXZFHlewEX9Kqhk5nRbTsy0G2wqWNmc9u10aD6dqjwV2Gxk9D843PW3MsvZguhxpHed6vEIu4-xDvVwlfkOn_vX-pB9CKAqIgXJohltAUGYaDZFF5Hhihp8yy2_jOErOcQ3ck Sep 20 05:06:32.918309 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Id: None Sep 20 05:06:32.918309 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Name: None Sep 20 05:06:32.918309 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Identity-Status: Confirmed Sep 20 05:06:32.918309 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Is-Admin-Project: True Sep 20 05:06:32.918309 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Id: default Sep 20 05:06:32.918309 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Name: Default Sep 20 05:06:32.918309 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Id: 3218048072f048d9afc65ae138523bfd Sep 20 05:06:32.918309 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Name: tempest-AttachVolumeTestJSON-1068414702 Sep 20 05:06:32.918309 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Role: reader,member Sep 20 05:06:32.918309 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Roles: reader,member Sep 20 05:06:32.919885 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3218048072f048d9afc65ae138523bfd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3218048072f048d9afc65ae138523bfd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3218048072f048d9afc65ae138523bfd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3218048072f048d9afc65ae138523bfd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 05:06:32.919885 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant: tempest-AttachVolumeTestJSON-1068414702 Sep 20 05:06:32.919885 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Id: 3218048072f048d9afc65ae138523bfd Sep 20 05:06:32.919885 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1068414702 Sep 20 05:06:32.919885 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User: tempest-AttachVolumeTestJSON-1068414702-project Sep 20 05:06:32.919885 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Id: default Sep 20 05:06:32.919885 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Name: Default Sep 20 05:06:32.919885 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Id: 1947f5ce1d794f05ae6272e8dba5d29c Sep 20 05:06:32.919885 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Name: tempest-AttachVolumeTestJSON-1068414702-project Sep 20 05:06:32.919885 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: method: > Sep 20 05:06:32.919885 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: exception: Instance 6a85f27c-bdfe-4580-8579-71ea2b71bbfd could not be found. Sep 20 05:06:32.919885 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: action_args: {'id': '6a85f27c-bdfe-4580-8579-71ea2b71bbfd'} Sep 20 05:06:32.920761 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 05:06:32.920761 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:06:32.920761 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 05:06:32.920761 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 05:06:32.920761 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 05:06:32.920761 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 05:06:32.920761 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 05:06:32.920761 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 05:06:32.920761 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 05:06:32.920761 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 05:06:32.920761 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a85f27c-bdfe-4580-8579-71ea2b71bbfd could not be found. Sep 20 05:06:32.920761 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:06:32.920761 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 05:06:32.920761 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:06:32.920761 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:06:32.920761 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 05:06:32.920761 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 05:06:32.920761 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 05:06:32.920761 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 05:06:32.920761 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 05:06:32.922252 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 05:06:32.922252 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 05:06:32.922252 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 05:06:32.922252 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 05:06:32.922252 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 05:06:32.922252 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 05:06:32.922252 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 05:06:32.922252 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a85f27c-bdfe-4580-8579-71ea2b71bbfd could not be found. Sep 20 05:06:32.922252 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:06:32.922252 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 05:06:32.922252 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:06:32.922252 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:06:32.922252 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 05:06:32.922252 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 05:06:32.922252 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 05:06:32.922252 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 05:06:32.922252 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a85f27c-bdfe-4580-8579-71ea2b71bbfd could not be found. Sep 20 05:06:32.922252 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:06:32.923717 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-05740020-d89d-461f-8ddf-9dd771e26227 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] Returning 404 to user: Instance 6a85f27c-bdfe-4580-8579-71ea2b71bbfd could not be found. {{(pid=126813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 05:06:32.923717 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-05740020-d89d-461f-8ddf-9dd771e26227 tempest-AttachVolumeTestJSON-1068414702 tempest-AttachVolumeTestJSON-1068414702-project] 10.222.0.27 "GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd" status: 404 len: 111 microversion: 2.1 time: 0.028925 Sep 20 05:06:32.923717 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 715/865] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:06:32 2022] GET /compute/v2.1/servers/6a85f27c-bdfe-4580-8579-71ea2b71bbfd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 20 05:06:50.934901 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-8bb9cd28-db65-4f31-a656-01a0001511f7 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1166718411", "imageRef": "080ea053-830e-4470-a886-0ab99b0ab3e0", "flavorRef": "452", "networks": [{"uuid": "6cfe5ac2-04e0-4e41-8498-095bf4a9e89b"}]}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:06:50.943928 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:06:50.944571 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:06:50.990713 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.network.neutron [None req-8bb9cd28-db65-4f31-a656-01a0001511f7 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] validate_networks() for [('6cfe5ac2-04e0-4e41-8498-095bf4a9e89b', None, None, None, None, None)] {{(pid=126813) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 20 05:06:51.330417 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-8bb9cd28-db65-4f31-a656-01a0001511f7 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Flavor limits 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 20 05:06:51.330872 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-8bb9cd28-db65-4f31-a656-01a0001511f7 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Image limits 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 20 05:06:51.331368 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-8bb9cd28-db65-4f31-a656-01a0001511f7 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Flavor pref 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 20 05:06:51.331771 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-8bb9cd28-db65-4f31-a656-01a0001511f7 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Image pref 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 20 05:06:51.332179 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-8bb9cd28-db65-4f31-a656-01a0001511f7 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 20 05:06:51.341000 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8bb9cd28-db65-4f31-a656-01a0001511f7 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:51.341475 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8bb9cd28-db65-4f31-a656-01a0001511f7 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:51.341907 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8bb9cd28-db65-4f31-a656-01a0001511f7 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:51.342629 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8bb9cd28-db65-4f31-a656-01a0001511f7 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:51.343075 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8bb9cd28-db65-4f31-a656-01a0001511f7 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:51.343492 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8bb9cd28-db65-4f31-a656-01a0001511f7 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:51.360267 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-8bb9cd28-db65-4f31-a656-01a0001511f7 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Getting quotas for project 975cd6183a57461a9604d14868f48d6f. Resources: {'ram', 'cores', 'instances'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 05:06:51.364166 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-8bb9cd28-db65-4f31-a656-01a0001511f7 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Getting quotas for user dadfd5efee64496d9d9322538fc4cde3 and project 975cd6183a57461a9604d14868f48d6f. Resources: {'ram', 'cores', 'instances'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 05:06:51.375388 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-8bb9cd28-db65-4f31-a656-01a0001511f7 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Going to run 1 instances... {{(pid=126813) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 20 05:06:51.377664 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-8bb9cd28-db65-4f31-a656-01a0001511f7 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] [instance: b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='080ea053-830e-4470-a886-0ab99b0ab3e0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126813) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 20 05:06:51.423437 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-8bb9cd28-db65-4f31-a656-01a0001511f7 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.492267 Sep 20 05:06:51.424080 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 716/866] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Sep 20 05:06:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 494 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 20 05:06:51.435365 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-846f4a14-3e5b-4d05-b813-f9c786539c05 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:06:51.435973 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-846f4a14-3e5b-4d05-b813-f9c786539c05 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] [instance: b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:06:51.488593 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-846f4a14-3e5b-4d05-b813-f9c786539c05 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadfd5efee64496d9d9322538fc4cde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975cd6183a57461a9604d14868f48d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:06:51.497093 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-846f4a14-3e5b-4d05-b813-f9c786539c05 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] 10.222.0.27 "GET /compute/v2.1/servers/b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1" status: 200 len: 1214 microversion: 2.1 time: 0.066026 Sep 20 05:06:51.497659 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 717/867] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:06:51 2022] GET /compute/v2.1/servers/b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1 => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:06:52.519763 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-962ca61b-19c2-4797-acba-edd062d5cf7d tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:06:52.520443 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-962ca61b-19c2-4797-acba-edd062d5cf7d tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] [instance: b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:06:52.527569 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-962ca61b-19c2-4797-acba-edd062d5cf7d tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:52.528061 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-962ca61b-19c2-4797-acba-edd062d5cf7d tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:52.528500 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-962ca61b-19c2-4797-acba-edd062d5cf7d tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:52.529414 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-962ca61b-19c2-4797-acba-edd062d5cf7d tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:52.529873 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-962ca61b-19c2-4797-acba-edd062d5cf7d tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:52.530400 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-962ca61b-19c2-4797-acba-edd062d5cf7d tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:52.598499 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-962ca61b-19c2-4797-acba-edd062d5cf7d tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadfd5efee64496d9d9322538fc4cde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975cd6183a57461a9604d14868f48d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:06:52.612714 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-962ca61b-19c2-4797-acba-edd062d5cf7d tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] 10.222.0.27 "GET /compute/v2.1/servers/b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1" status: 200 len: 1284 microversion: 2.1 time: 0.096741 Sep 20 05:06:52.613672 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 718/868] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:06:52 2022] GET /compute/v2.1/servers/b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1 => generated 1284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:06:53.636991 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-805a7d5c-fc8a-4f10-bc21-500ee09673c4 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:06:53.637675 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-805a7d5c-fc8a-4f10-bc21-500ee09673c4 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] [instance: b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:06:53.643970 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-805a7d5c-fc8a-4f10-bc21-500ee09673c4 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:53.644782 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-805a7d5c-fc8a-4f10-bc21-500ee09673c4 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:53.645217 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-805a7d5c-fc8a-4f10-bc21-500ee09673c4 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:53.645903 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-805a7d5c-fc8a-4f10-bc21-500ee09673c4 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:53.646348 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-805a7d5c-fc8a-4f10-bc21-500ee09673c4 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:53.646764 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-805a7d5c-fc8a-4f10-bc21-500ee09673c4 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:53.776129 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-805a7d5c-fc8a-4f10-bc21-500ee09673c4 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadfd5efee64496d9d9322538fc4cde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975cd6183a57461a9604d14868f48d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:06:53.784656 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-805a7d5c-fc8a-4f10-bc21-500ee09673c4 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] 10.222.0.27 "GET /compute/v2.1/servers/b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1" status: 200 len: 1314 microversion: 2.1 time: 0.152062 Sep 20 05:06:53.785219 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 719/869] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:06:53 2022] GET /compute/v2.1/servers/b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 05:06:53.805828 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-f3b94680-2418-4208-811a-eb88f975eb89 req-f241e023-77ce-476a-b94f-42bbe586c65b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1", "tag": "7c8f6e0f-7fa2-4375-bde1-19e9768711e5"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:06:53.818463 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-f3b94680-2418-4208-811a-eb88f975eb89 req-f241e023-77ce-476a-b94f-42bbe586c65b service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:53.819010 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-f3b94680-2418-4208-811a-eb88f975eb89 req-f241e023-77ce-476a-b94f-42bbe586c65b service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:53.819458 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-f3b94680-2418-4208-811a-eb88f975eb89 req-f241e023-77ce-476a-b94f-42bbe586c65b service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:53.831427 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-f3b94680-2418-4208-811a-eb88f975eb89 req-f241e023-77ce-476a-b94f-42bbe586c65b service nova] Creating event network-changed:7c8f6e0f-7fa2-4375-bde1-19e9768711e5 for instance b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1 on hv-cinder-75671 Sep 20 05:06:53.836572 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-f3b94680-2418-4208-811a-eb88f975eb89 req-f241e023-77ce-476a-b94f-42bbe586c65b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040940 Sep 20 05:06:53.837195 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 720/870] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 05:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 05:06:54.809601 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-78d85113-2c80-4325-8be6-c44a6834d7de tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:06:54.810287 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-78d85113-2c80-4325-8be6-c44a6834d7de tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] [instance: b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:06:54.816437 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-78d85113-2c80-4325-8be6-c44a6834d7de tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:54.816941 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-78d85113-2c80-4325-8be6-c44a6834d7de tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:54.817376 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-78d85113-2c80-4325-8be6-c44a6834d7de tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:54.818055 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-78d85113-2c80-4325-8be6-c44a6834d7de tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:54.818502 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-78d85113-2c80-4325-8be6-c44a6834d7de tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:54.818921 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-78d85113-2c80-4325-8be6-c44a6834d7de tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:54.951333 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-78d85113-2c80-4325-8be6-c44a6834d7de tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadfd5efee64496d9d9322538fc4cde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975cd6183a57461a9604d14868f48d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:06:54.959165 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-78d85113-2c80-4325-8be6-c44a6834d7de tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] 10.222.0.27 "GET /compute/v2.1/servers/b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1" status: 200 len: 1314 microversion: 2.1 time: 0.154766 Sep 20 05:06:54.959814 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 721/871] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:06:54 2022] GET /compute/v2.1/servers/b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:06:55.982512 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-b31f0526-c594-4946-83e6-c3f8cec9d95c tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:06:55.983193 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-b31f0526-c594-4946-83e6-c3f8cec9d95c tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] [instance: b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:06:55.989537 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b31f0526-c594-4946-83e6-c3f8cec9d95c tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:55.990015 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b31f0526-c594-4946-83e6-c3f8cec9d95c tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:55.990449 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b31f0526-c594-4946-83e6-c3f8cec9d95c tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:55.991131 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b31f0526-c594-4946-83e6-c3f8cec9d95c tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:55.991580 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b31f0526-c594-4946-83e6-c3f8cec9d95c tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:55.992002 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b31f0526-c594-4946-83e6-c3f8cec9d95c tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:56.114935 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-b31f0526-c594-4946-83e6-c3f8cec9d95c tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadfd5efee64496d9d9322538fc4cde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975cd6183a57461a9604d14868f48d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:06:56.123122 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-b31f0526-c594-4946-83e6-c3f8cec9d95c tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] 10.222.0.27 "GET /compute/v2.1/servers/b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1" status: 200 len: 1314 microversion: 2.1 time: 0.145006 Sep 20 05:06:56.123677 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 722/872] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:06:55 2022] GET /compute/v2.1/servers/b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:06:57.145712 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-37ed6607-76dd-4910-8b46-f9fcef7c5a9f tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:06:57.146328 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-37ed6607-76dd-4910-8b46-f9fcef7c5a9f tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] [instance: b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:06:57.152543 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-37ed6607-76dd-4910-8b46-f9fcef7c5a9f tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:57.153051 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-37ed6607-76dd-4910-8b46-f9fcef7c5a9f tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:57.153480 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-37ed6607-76dd-4910-8b46-f9fcef7c5a9f tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:57.154165 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-37ed6607-76dd-4910-8b46-f9fcef7c5a9f tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:57.154612 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-37ed6607-76dd-4910-8b46-f9fcef7c5a9f tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:57.155027 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-37ed6607-76dd-4910-8b46-f9fcef7c5a9f tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:57.523890 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-37ed6607-76dd-4910-8b46-f9fcef7c5a9f tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadfd5efee64496d9d9322538fc4cde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975cd6183a57461a9604d14868f48d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:06:57.531506 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-37ed6607-76dd-4910-8b46-f9fcef7c5a9f tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] 10.222.0.27 "GET /compute/v2.1/servers/b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1" status: 200 len: 1314 microversion: 2.1 time: 0.390135 Sep 20 05:06:57.532067 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 723/873] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:06:57 2022] GET /compute/v2.1/servers/b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1 => generated 1314 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:06:58.555068 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-fb7e9687-8b18-4e64-b2c2-1b391b3498bc tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:06:58.555719 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-fb7e9687-8b18-4e64-b2c2-1b391b3498bc tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] [instance: b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:06:58.562110 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fb7e9687-8b18-4e64-b2c2-1b391b3498bc tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:58.562590 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fb7e9687-8b18-4e64-b2c2-1b391b3498bc tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:58.563027 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fb7e9687-8b18-4e64-b2c2-1b391b3498bc tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:58.563715 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fb7e9687-8b18-4e64-b2c2-1b391b3498bc tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:58.564151 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fb7e9687-8b18-4e64-b2c2-1b391b3498bc tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:58.564639 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fb7e9687-8b18-4e64-b2c2-1b391b3498bc tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:58.691162 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-fb7e9687-8b18-4e64-b2c2-1b391b3498bc tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadfd5efee64496d9d9322538fc4cde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975cd6183a57461a9604d14868f48d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:06:58.698672 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-fb7e9687-8b18-4e64-b2c2-1b391b3498bc tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] 10.222.0.27 "GET /compute/v2.1/servers/b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1" status: 200 len: 1314 microversion: 2.1 time: 0.147402 Sep 20 05:06:58.699230 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 724/874] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:06:58 2022] GET /compute/v2.1/servers/b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:06:59.062439 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-e8a61c45-ef98-4f23-a373-a9c3c11818ac req-945824b3-6091-4ef1-aa78-37a4e34b342a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1", "name": "network-vif-plugged", "status": "completed", "tag": "7c8f6e0f-7fa2-4375-bde1-19e9768711e5"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:06:59.074179 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-e8a61c45-ef98-4f23-a373-a9c3c11818ac req-945824b3-6091-4ef1-aa78-37a4e34b342a service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:59.074903 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-e8a61c45-ef98-4f23-a373-a9c3c11818ac req-945824b3-6091-4ef1-aa78-37a4e34b342a service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:59.075336 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-e8a61c45-ef98-4f23-a373-a9c3c11818ac req-945824b3-6091-4ef1-aa78-37a4e34b342a service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:59.086270 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-e8a61c45-ef98-4f23-a373-a9c3c11818ac req-945824b3-6091-4ef1-aa78-37a4e34b342a service nova] Creating event network-vif-plugged:7c8f6e0f-7fa2-4375-bde1-19e9768711e5 for instance b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1 on hv-cinder-75671 Sep 20 05:06:59.091716 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-e8a61c45-ef98-4f23-a373-a9c3c11818ac req-945824b3-6091-4ef1-aa78-37a4e34b342a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032971 Sep 20 05:06:59.092515 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 725/875] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 05:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 05:06:59.722531 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-0e564220-88f7-49f6-884f-6c40c134b0d2 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:06:59.723204 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-0e564220-88f7-49f6-884f-6c40c134b0d2 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] [instance: b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:06:59.730332 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0e564220-88f7-49f6-884f-6c40c134b0d2 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:59.730806 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0e564220-88f7-49f6-884f-6c40c134b0d2 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:59.731235 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0e564220-88f7-49f6-884f-6c40c134b0d2 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:59.731919 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0e564220-88f7-49f6-884f-6c40c134b0d2 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:06:59.732365 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0e564220-88f7-49f6-884f-6c40c134b0d2 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:06:59.732913 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0e564220-88f7-49f6-884f-6c40c134b0d2 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:06:59.860184 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-0e564220-88f7-49f6-884f-6c40c134b0d2 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadfd5efee64496d9d9322538fc4cde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975cd6183a57461a9604d14868f48d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:06:59.868194 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-0e564220-88f7-49f6-884f-6c40c134b0d2 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] 10.222.0.27 "GET /compute/v2.1/servers/b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1" status: 200 len: 1314 microversion: 2.1 time: 0.149816 Sep 20 05:06:59.868778 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 726/876] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:06:59 2022] GET /compute/v2.1/servers/b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:07:00.891207 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-6bf60632-7b85-41ea-aa89-dbf4d6fab132 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:07:00.891813 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-6bf60632-7b85-41ea-aa89-dbf4d6fab132 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] [instance: b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:07:00.898433 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6bf60632-7b85-41ea-aa89-dbf4d6fab132 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:07:00.898907 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6bf60632-7b85-41ea-aa89-dbf4d6fab132 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:07:00.899339 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6bf60632-7b85-41ea-aa89-dbf4d6fab132 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:07:00.900012 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6bf60632-7b85-41ea-aa89-dbf4d6fab132 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:07:00.900459 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6bf60632-7b85-41ea-aa89-dbf4d6fab132 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:07:00.900899 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6bf60632-7b85-41ea-aa89-dbf4d6fab132 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:07:01.026894 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-6bf60632-7b85-41ea-aa89-dbf4d6fab132 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadfd5efee64496d9d9322538fc4cde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975cd6183a57461a9604d14868f48d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:07:01.034433 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-6bf60632-7b85-41ea-aa89-dbf4d6fab132 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] 10.222.0.27 "GET /compute/v2.1/servers/b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1" status: 200 len: 1497 microversion: 2.1 time: 0.147077 Sep 20 05:07:01.034985 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 727/877] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:07:00 2022] GET /compute/v2.1/servers/b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1 => generated 1497 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:07:01.512357 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-01aed2f7-8fd0-4895-8838-ed7c7b7048ca tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:07:01.512876 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-01aed2f7-8fd0-4895-8838-ed7c7b7048ca tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] [instance: b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:07:01.514848 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell0:SELECT=2 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:07:01.515535 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell0:SELECT=8 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:07:01.521734 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-01aed2f7-8fd0-4895-8838-ed7c7b7048ca tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:07:01.522209 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-01aed2f7-8fd0-4895-8838-ed7c7b7048ca tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:07:01.522635 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-01aed2f7-8fd0-4895-8838-ed7c7b7048ca tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:07:01.523311 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-01aed2f7-8fd0-4895-8838-ed7c7b7048ca tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:07:01.523756 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-01aed2f7-8fd0-4895-8838-ed7c7b7048ca tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:07:01.524186 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-01aed2f7-8fd0-4895-8838-ed7c7b7048ca tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:07:01.548468 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-01aed2f7-8fd0-4895-8838-ed7c7b7048ca tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] [instance: b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1] Going to try to terminate instance {{(pid=126813) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 20 05:07:01.622224 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-01aed2f7-8fd0-4895-8838-ed7c7b7048ca tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1" status: 204 len: 0 microversion: 2.1 time: 0.114092 Sep 20 05:07:01.622788 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 728/878] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Sep 20 05:07:01 2022] DELETE /compute/v2.1/servers/b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 20 05:07:01.631842 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-89e95bdd-362d-44db-8567-9546a5bfef7a tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:07:01.632535 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-89e95bdd-362d-44db-8567-9546a5bfef7a tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] [instance: b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:07:01.638529 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-89e95bdd-362d-44db-8567-9546a5bfef7a tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:07:01.639053 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-89e95bdd-362d-44db-8567-9546a5bfef7a tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:07:01.639492 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-89e95bdd-362d-44db-8567-9546a5bfef7a tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:07:01.640191 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-89e95bdd-362d-44db-8567-9546a5bfef7a tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:07:01.640675 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-89e95bdd-362d-44db-8567-9546a5bfef7a tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:07:01.641132 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-89e95bdd-362d-44db-8567-9546a5bfef7a tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:07:01.775929 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-89e95bdd-362d-44db-8567-9546a5bfef7a tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadfd5efee64496d9d9322538fc4cde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975cd6183a57461a9604d14868f48d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:07:01.784071 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-89e95bdd-362d-44db-8567-9546a5bfef7a tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] 10.222.0.27 "GET /compute/v2.1/servers/b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1" status: 200 len: 1503 microversion: 2.1 time: 0.156173 Sep 20 05:07:01.784679 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 729/879] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:07:01 2022] GET /compute/v2.1/servers/b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:07:02.809204 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-3c07dfa6-dad6-41ff-8722-fbcdeb19ad1f tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:07:02.809872 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-3c07dfa6-dad6-41ff-8722-fbcdeb19ad1f tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] [instance: b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:07:02.816201 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3c07dfa6-dad6-41ff-8722-fbcdeb19ad1f tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:07:02.816714 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3c07dfa6-dad6-41ff-8722-fbcdeb19ad1f tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:07:02.817155 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3c07dfa6-dad6-41ff-8722-fbcdeb19ad1f tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:07:02.817863 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3c07dfa6-dad6-41ff-8722-fbcdeb19ad1f tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:07:02.818299 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3c07dfa6-dad6-41ff-8722-fbcdeb19ad1f tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:07:02.818720 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3c07dfa6-dad6-41ff-8722-fbcdeb19ad1f tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:07:02.950322 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-3c07dfa6-dad6-41ff-8722-fbcdeb19ad1f tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadfd5efee64496d9d9322538fc4cde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975cd6183a57461a9604d14868f48d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:07:02.958152 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-3c07dfa6-dad6-41ff-8722-fbcdeb19ad1f tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] 10.222.0.27 "GET /compute/v2.1/servers/b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1" status: 200 len: 1503 microversion: 2.1 time: 0.152782 Sep 20 05:07:02.958710 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 730/880] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:07:02 2022] GET /compute/v2.1/servers/b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:07:03.517607 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-a3b2699c-df44-4c35-b37c-2b600f47f761 req-97dbcfe2-0c1e-4830-bd38-60e3e70bba0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1", "name": "network-vif-deleted", "tag": "7c8f6e0f-7fa2-4375-bde1-19e9768711e5"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:07:03.529590 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-a3b2699c-df44-4c35-b37c-2b600f47f761 req-97dbcfe2-0c1e-4830-bd38-60e3e70bba0c service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:07:03.530063 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-a3b2699c-df44-4c35-b37c-2b600f47f761 req-97dbcfe2-0c1e-4830-bd38-60e3e70bba0c service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:07:03.530496 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-a3b2699c-df44-4c35-b37c-2b600f47f761 req-97dbcfe2-0c1e-4830-bd38-60e3e70bba0c service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:07:03.546285 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-a3b2699c-df44-4c35-b37c-2b600f47f761 req-97dbcfe2-0c1e-4830-bd38-60e3e70bba0c service nova] Creating event network-vif-deleted:7c8f6e0f-7fa2-4375-bde1-19e9768711e5 for instance b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1 on hv-cinder-75671 Sep 20 05:07:03.552379 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-a3b2699c-df44-4c35-b37c-2b600f47f761 req-97dbcfe2-0c1e-4830-bd38-60e3e70bba0c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038433 Sep 20 05:07:03.553015 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 731/881] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 05:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 05:07:03.982465 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-afa6c861-9c1f-4fff-bf19-aa94fd4b6b14 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:07:03.983190 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-afa6c861-9c1f-4fff-bf19-aa94fd4b6b14 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] [instance: b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:07:03.989883 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-afa6c861-9c1f-4fff-bf19-aa94fd4b6b14 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:07:03.990379 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-afa6c861-9c1f-4fff-bf19-aa94fd4b6b14 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:07:03.990805 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-afa6c861-9c1f-4fff-bf19-aa94fd4b6b14 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:07:03.991607 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-afa6c861-9c1f-4fff-bf19-aa94fd4b6b14 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:07:03.992060 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-afa6c861-9c1f-4fff-bf19-aa94fd4b6b14 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:07:03.992491 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-afa6c861-9c1f-4fff-bf19-aa94fd4b6b14 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:07:04.023871 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-afa6c861-9c1f-4fff-bf19-aa94fd4b6b14 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:07:04.024349 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-afa6c861-9c1f-4fff-bf19-aa94fd4b6b14 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:07:04.024816 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-afa6c861-9c1f-4fff-bf19-aa94fd4b6b14 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:07:04.025261 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.objects.instance [None req-afa6c861-9c1f-4fff-bf19-aa94fd4b6b14 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lazy-loading 'fault' on Instance uuid b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1 {{(pid=126813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 05:07:04.066336 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-afa6c861-9c1f-4fff-bf19-aa94fd4b6b14 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadfd5efee64496d9d9322538fc4cde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975cd6183a57461a9604d14868f48d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:07:04.075203 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-afa6c861-9c1f-4fff-bf19-aa94fd4b6b14 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] 10.222.0.27 "GET /compute/v2.1/servers/b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1" status: 200 len: 1304 microversion: 2.1 time: 0.097495 Sep 20 05:07:04.075830 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 732/882] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:07:03 2022] GET /compute/v2.1/servers/b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1 => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:07:05.098862 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-0ea2c945-b764-45a4-82f6-c86636a8b126 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:07:05.099548 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-0ea2c945-b764-45a4-82f6-c86636a8b126 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] [instance: b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:07:05.106453 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0ea2c945-b764-45a4-82f6-c86636a8b126 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:07:05.106933 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0ea2c945-b764-45a4-82f6-c86636a8b126 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:07:05.107367 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0ea2c945-b764-45a4-82f6-c86636a8b126 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:07:05.108051 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0ea2c945-b764-45a4-82f6-c86636a8b126 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:07:05.108500 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0ea2c945-b764-45a4-82f6-c86636a8b126 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:07:05.108952 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0ea2c945-b764-45a4-82f6-c86636a8b126 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:07:05.122584 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.wsgi [None req-0ea2c945-b764-45a4-82f6-c86636a8b126 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] HTTP exception thrown: Instance b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1 could not be found. Sep 20 05:07:05.124203 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-0ea2c945-b764-45a4-82f6-c86636a8b126 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Request method failure captured: Sep 20 05:07:05.124203 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: request: GET /compute/v2.1/servers/b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1 HTTP/1.1 Sep 20 05:07:05.124203 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept: application/json Sep 20 05:07:05.124203 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept-Encoding: identity Sep 20 05:07:05.124203 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Connection: close Sep 20 05:07:05.124203 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Length: 0 Sep 20 05:07:05.124203 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Type: application/json Sep 20 05:07:05.124203 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Host: 10.222.0.27 Sep 20 05:07:05.124203 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Openstack-System-Scope: None Sep 20 05:07:05.124203 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: User-Agent: python-urllib3/1.26.12 Sep 20 05:07:05.124203 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Auth-Token: gAAAAABjKUpp0OuPs03agpvFoN71wzcyWdvHFLTFUxQDaVrAIrb3gWM7wW-ddBSqVyWVGfYSUguhp7sIeEgVcQhPOk80NfQb10nKgmaoEhCbxR8J2FShYbbAq6h7pbLCIZfxyDXygSE41vTMBKv4G4nJVOyYmeR_olGekhjWInw0dKeL6g45UGM Sep 20 05:07:05.124203 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Id: None Sep 20 05:07:05.124203 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Name: None Sep 20 05:07:05.124203 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Identity-Status: Confirmed Sep 20 05:07:05.124203 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Is-Admin-Project: True Sep 20 05:07:05.124203 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Id: default Sep 20 05:07:05.124203 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Name: Default Sep 20 05:07:05.124203 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Id: 975cd6183a57461a9604d14868f48d6f Sep 20 05:07:05.124203 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Name: tempest-VolumesActionsTest-1338137131 Sep 20 05:07:05.124203 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Role: reader,member Sep 20 05:07:05.124203 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Roles: reader,member Sep 20 05:07:05.125909 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/975cd6183a57461a9604d14868f48d6f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/975cd6183a57461a9604d14868f48d6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_975cd6183a57461a9604d14868f48d6f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/975cd6183a57461a9604d14868f48d6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 05:07:05.125909 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant: tempest-VolumesActionsTest-1338137131 Sep 20 05:07:05.125909 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Id: 975cd6183a57461a9604d14868f48d6f Sep 20 05:07:05.125909 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Name: tempest-VolumesActionsTest-1338137131 Sep 20 05:07:05.125909 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User: tempest-VolumesActionsTest-1338137131-project Sep 20 05:07:05.125909 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Id: default Sep 20 05:07:05.125909 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Name: Default Sep 20 05:07:05.125909 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Id: dadfd5efee64496d9d9322538fc4cde3 Sep 20 05:07:05.125909 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Name: tempest-VolumesActionsTest-1338137131-project Sep 20 05:07:05.125909 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: method: > Sep 20 05:07:05.125909 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: exception: Instance b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1 could not be found. Sep 20 05:07:05.125909 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: action_args: {'id': 'b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1'} Sep 20 05:07:05.126812 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 05:07:05.126812 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:07:05.126812 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 05:07:05.126812 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 05:07:05.126812 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 05:07:05.126812 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 05:07:05.126812 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 05:07:05.126812 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 05:07:05.126812 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 05:07:05.126812 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 05:07:05.126812 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1 could not be found. Sep 20 05:07:05.126812 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:07:05.126812 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 05:07:05.126812 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:07:05.126812 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:07:05.126812 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 05:07:05.126812 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 05:07:05.126812 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 05:07:05.126812 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 05:07:05.126812 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 05:07:05.128221 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 05:07:05.128221 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 05:07:05.128221 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 05:07:05.128221 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 05:07:05.128221 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 05:07:05.128221 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 05:07:05.128221 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 05:07:05.128221 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1 could not be found. Sep 20 05:07:05.128221 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:07:05.128221 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 05:07:05.128221 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:07:05.128221 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:07:05.128221 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 05:07:05.128221 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 05:07:05.128221 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 05:07:05.128221 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 05:07:05.128221 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1 could not be found. Sep 20 05:07:05.128221 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:07:05.129477 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-0ea2c945-b764-45a4-82f6-c86636a8b126 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Returning 404 to user: Instance b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1 could not be found. {{(pid=126813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 05:07:05.129477 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-0ea2c945-b764-45a4-82f6-c86636a8b126 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] 10.222.0.27 "GET /compute/v2.1/servers/b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1" status: 404 len: 111 microversion: 2.1 time: 0.030591 Sep 20 05:07:05.129477 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 733/883] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:07:05 2022] GET /compute/v2.1/servers/b1dfb1ff-7109-4991-bcd3-6afbdd0fa4a1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 20 05:07:05.174008 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-b0686ccf-4f14-4453-aef1-37c805c4abe8 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1863233130", "imageRef": "080ea053-830e-4470-a886-0ab99b0ab3e0", "flavorRef": "452", "networks": [{"uuid": "6cfe5ac2-04e0-4e41-8498-095bf4a9e89b"}]}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:07:05.226046 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.network.neutron [None req-b0686ccf-4f14-4453-aef1-37c805c4abe8 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] validate_networks() for [('6cfe5ac2-04e0-4e41-8498-095bf4a9e89b', None, None, None, None, None)] {{(pid=126813) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 20 05:07:05.560199 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-b0686ccf-4f14-4453-aef1-37c805c4abe8 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Flavor limits 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 20 05:07:05.560664 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-b0686ccf-4f14-4453-aef1-37c805c4abe8 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Image limits 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 20 05:07:05.561146 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-b0686ccf-4f14-4453-aef1-37c805c4abe8 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Flavor pref 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 20 05:07:05.561729 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-b0686ccf-4f14-4453-aef1-37c805c4abe8 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Image pref 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 20 05:07:05.561970 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-b0686ccf-4f14-4453-aef1-37c805c4abe8 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 20 05:07:05.570817 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b0686ccf-4f14-4453-aef1-37c805c4abe8 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:07:05.571297 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b0686ccf-4f14-4453-aef1-37c805c4abe8 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:07:05.571732 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b0686ccf-4f14-4453-aef1-37c805c4abe8 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:07:05.572461 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b0686ccf-4f14-4453-aef1-37c805c4abe8 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:07:05.572945 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b0686ccf-4f14-4453-aef1-37c805c4abe8 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:07:05.573381 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b0686ccf-4f14-4453-aef1-37c805c4abe8 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:07:05.590987 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-b0686ccf-4f14-4453-aef1-37c805c4abe8 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Getting quotas for project 975cd6183a57461a9604d14868f48d6f. Resources: {'ram', 'cores', 'instances'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 05:07:05.594998 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-b0686ccf-4f14-4453-aef1-37c805c4abe8 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Getting quotas for user dadfd5efee64496d9d9322538fc4cde3 and project 975cd6183a57461a9604d14868f48d6f. Resources: {'ram', 'cores', 'instances'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 05:07:05.605707 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-b0686ccf-4f14-4453-aef1-37c805c4abe8 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Going to run 1 instances... {{(pid=126813) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 20 05:07:05.607971 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-b0686ccf-4f14-4453-aef1-37c805c4abe8 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] [instance: ee2e8d9f-423a-46f3-a71c-357805683bec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='080ea053-830e-4470-a886-0ab99b0ab3e0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126813) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 20 05:07:05.654664 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-b0686ccf-4f14-4453-aef1-37c805c4abe8 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.484293 Sep 20 05:07:05.655301 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 734/884] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Sep 20 05:07:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 486 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 20 05:07:05.665907 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-f0dafb9d-6213-4735-9a6b-e71cc8479e0d tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:07:05.666528 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-f0dafb9d-6213-4735-9a6b-e71cc8479e0d tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] [instance: ee2e8d9f-423a-46f3-a71c-357805683bec] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:07:05.722083 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-f0dafb9d-6213-4735-9a6b-e71cc8479e0d tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadfd5efee64496d9d9322538fc4cde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975cd6183a57461a9604d14868f48d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:07:05.729681 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-f0dafb9d-6213-4735-9a6b-e71cc8479e0d tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] 10.222.0.27 "GET /compute/v2.1/servers/ee2e8d9f-423a-46f3-a71c-357805683bec" status: 200 len: 1214 microversion: 2.1 time: 0.067394 Sep 20 05:07:05.730278 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 735/885] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:07:05 2022] GET /compute/v2.1/servers/ee2e8d9f-423a-46f3-a71c-357805683bec => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:07:06.752272 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-53f0f380-d606-4e83-8e38-f9a6b361e962 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:07:06.753112 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-53f0f380-d606-4e83-8e38-f9a6b361e962 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] [instance: ee2e8d9f-423a-46f3-a71c-357805683bec] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:07:06.759890 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-53f0f380-d606-4e83-8e38-f9a6b361e962 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:07:06.760430 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-53f0f380-d606-4e83-8e38-f9a6b361e962 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:07:06.761533 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-53f0f380-d606-4e83-8e38-f9a6b361e962 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:07:06.762772 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-53f0f380-d606-4e83-8e38-f9a6b361e962 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:07:06.763243 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-53f0f380-d606-4e83-8e38-f9a6b361e962 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:07:06.763665 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-53f0f380-d606-4e83-8e38-f9a6b361e962 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:07:06.782970 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:07:06.829612 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-53f0f380-d606-4e83-8e38-f9a6b361e962 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadfd5efee64496d9d9322538fc4cde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975cd6183a57461a9604d14868f48d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:07:06.837299 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-53f0f380-d606-4e83-8e38-f9a6b361e962 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] 10.222.0.27 "GET /compute/v2.1/servers/ee2e8d9f-423a-46f3-a71c-357805683bec" status: 200 len: 1272 microversion: 2.1 time: 0.089641 Sep 20 05:07:06.837889 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 736/886] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:07:06 2022] GET /compute/v2.1/servers/ee2e8d9f-423a-46f3-a71c-357805683bec => generated 1272 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:07:07.861465 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-db1a020f-55bc-4afe-998b-ab4734f2e64f tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:07:07.862092 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-db1a020f-55bc-4afe-998b-ab4734f2e64f tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] [instance: ee2e8d9f-423a-46f3-a71c-357805683bec] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:07:07.868562 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-db1a020f-55bc-4afe-998b-ab4734f2e64f tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:07:07.869083 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-db1a020f-55bc-4afe-998b-ab4734f2e64f tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:07:07.869561 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-db1a020f-55bc-4afe-998b-ab4734f2e64f tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:07:07.870175 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-db1a020f-55bc-4afe-998b-ab4734f2e64f tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:07:07.870627 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-db1a020f-55bc-4afe-998b-ab4734f2e64f tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:07:07.871672 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-db1a020f-55bc-4afe-998b-ab4734f2e64f tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:07:08.003583 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-db1a020f-55bc-4afe-998b-ab4734f2e64f tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadfd5efee64496d9d9322538fc4cde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975cd6183a57461a9604d14868f48d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:07:08.012478 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-db1a020f-55bc-4afe-998b-ab4734f2e64f tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] 10.222.0.27 "GET /compute/v2.1/servers/ee2e8d9f-423a-46f3-a71c-357805683bec" status: 200 len: 1314 microversion: 2.1 time: 0.154798 Sep 20 05:07:08.019444 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 737/887] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:07:07 2022] GET /compute/v2.1/servers/ee2e8d9f-423a-46f3-a71c-357805683bec => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:07:08.019444 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-ec9c756e-8c03-499e-9b59-df3b76e01c7f req-d3416862-ccf0-4c12-882e-18f3f8d51159 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee2e8d9f-423a-46f3-a71c-357805683bec", "tag": "06d0e976-343a-4b0a-881d-734d86ec4bf0"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:07:08.030607 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-ec9c756e-8c03-499e-9b59-df3b76e01c7f req-d3416862-ccf0-4c12-882e-18f3f8d51159 service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:07:08.031426 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-ec9c756e-8c03-499e-9b59-df3b76e01c7f req-d3416862-ccf0-4c12-882e-18f3f8d51159 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:07:08.032032 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-ec9c756e-8c03-499e-9b59-df3b76e01c7f req-d3416862-ccf0-4c12-882e-18f3f8d51159 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:07:08.043973 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-ec9c756e-8c03-499e-9b59-df3b76e01c7f req-d3416862-ccf0-4c12-882e-18f3f8d51159 service nova] Creating event network-changed:06d0e976-343a-4b0a-881d-734d86ec4bf0 for instance ee2e8d9f-423a-46f3-a71c-357805683bec on hv-cinder-75671 Sep 20 05:07:08.049087 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-ec9c756e-8c03-499e-9b59-df3b76e01c7f req-d3416862-ccf0-4c12-882e-18f3f8d51159 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034151 Sep 20 05:07:08.049689 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 738/888] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 05:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 05:07:09.039800 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-3a1008fb-444d-4344-b187-032318c93d31 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:07:09.040477 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-3a1008fb-444d-4344-b187-032318c93d31 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] [instance: ee2e8d9f-423a-46f3-a71c-357805683bec] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:07:09.047329 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3a1008fb-444d-4344-b187-032318c93d31 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:07:09.047804 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3a1008fb-444d-4344-b187-032318c93d31 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:07:09.048234 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3a1008fb-444d-4344-b187-032318c93d31 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:07:09.048955 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3a1008fb-444d-4344-b187-032318c93d31 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:07:09.049401 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3a1008fb-444d-4344-b187-032318c93d31 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:07:09.049817 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3a1008fb-444d-4344-b187-032318c93d31 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:07:09.186848 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-3a1008fb-444d-4344-b187-032318c93d31 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadfd5efee64496d9d9322538fc4cde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975cd6183a57461a9604d14868f48d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:07:09.194398 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-3a1008fb-444d-4344-b187-032318c93d31 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] 10.222.0.27 "GET /compute/v2.1/servers/ee2e8d9f-423a-46f3-a71c-357805683bec" status: 200 len: 1314 microversion: 2.1 time: 0.159254 Sep 20 05:07:09.194962 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 739/889] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:07:09 2022] GET /compute/v2.1/servers/ee2e8d9f-423a-46f3-a71c-357805683bec => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:07:10.216578 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-b6381671-c371-47f8-8f89-fd510e0f5fd2 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:07:10.217139 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-b6381671-c371-47f8-8f89-fd510e0f5fd2 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] [instance: ee2e8d9f-423a-46f3-a71c-357805683bec] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:07:10.223502 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b6381671-c371-47f8-8f89-fd510e0f5fd2 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:07:10.223974 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b6381671-c371-47f8-8f89-fd510e0f5fd2 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:07:10.224404 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b6381671-c371-47f8-8f89-fd510e0f5fd2 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:07:10.225109 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b6381671-c371-47f8-8f89-fd510e0f5fd2 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:07:10.225561 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b6381671-c371-47f8-8f89-fd510e0f5fd2 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:07:10.225980 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b6381671-c371-47f8-8f89-fd510e0f5fd2 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:07:10.350650 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-b6381671-c371-47f8-8f89-fd510e0f5fd2 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadfd5efee64496d9d9322538fc4cde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975cd6183a57461a9604d14868f48d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:07:10.358491 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-b6381671-c371-47f8-8f89-fd510e0f5fd2 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] 10.222.0.27 "GET /compute/v2.1/servers/ee2e8d9f-423a-46f3-a71c-357805683bec" status: 200 len: 1314 microversion: 2.1 time: 0.146394 Sep 20 05:07:10.359051 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 740/890] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:07:10 2022] GET /compute/v2.1/servers/ee2e8d9f-423a-46f3-a71c-357805683bec => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:07:11.380780 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-4badf71d-4c90-4652-8aed-45493d30af12 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:07:11.381429 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-4badf71d-4c90-4652-8aed-45493d30af12 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] [instance: ee2e8d9f-423a-46f3-a71c-357805683bec] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:07:11.387870 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4badf71d-4c90-4652-8aed-45493d30af12 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:07:11.388348 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4badf71d-4c90-4652-8aed-45493d30af12 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:07:11.388815 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4badf71d-4c90-4652-8aed-45493d30af12 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:07:11.389499 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4badf71d-4c90-4652-8aed-45493d30af12 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:07:11.389950 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4badf71d-4c90-4652-8aed-45493d30af12 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:07:11.390371 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4badf71d-4c90-4652-8aed-45493d30af12 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:07:11.517406 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-4badf71d-4c90-4652-8aed-45493d30af12 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadfd5efee64496d9d9322538fc4cde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975cd6183a57461a9604d14868f48d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:07:11.525296 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-4badf71d-4c90-4652-8aed-45493d30af12 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] 10.222.0.27 "GET /compute/v2.1/servers/ee2e8d9f-423a-46f3-a71c-357805683bec" status: 200 len: 1314 microversion: 2.1 time: 0.148427 Sep 20 05:07:11.525866 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 741/891] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:07:11 2022] GET /compute/v2.1/servers/ee2e8d9f-423a-46f3-a71c-357805683bec => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:07:12.548280 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-8ac04506-f97b-47c7-b607-4a775402e61d tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:07:12.548939 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-8ac04506-f97b-47c7-b607-4a775402e61d tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] [instance: ee2e8d9f-423a-46f3-a71c-357805683bec] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:07:12.555425 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8ac04506-f97b-47c7-b607-4a775402e61d tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:07:12.555910 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8ac04506-f97b-47c7-b607-4a775402e61d tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:07:12.556343 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8ac04506-f97b-47c7-b607-4a775402e61d tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:07:12.557066 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8ac04506-f97b-47c7-b607-4a775402e61d tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:07:12.557515 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8ac04506-f97b-47c7-b607-4a775402e61d tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:07:12.557946 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8ac04506-f97b-47c7-b607-4a775402e61d tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:07:12.689108 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-8ac04506-f97b-47c7-b607-4a775402e61d tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadfd5efee64496d9d9322538fc4cde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975cd6183a57461a9604d14868f48d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:07:12.696641 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-8ac04506-f97b-47c7-b607-4a775402e61d tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] 10.222.0.27 "GET /compute/v2.1/servers/ee2e8d9f-423a-46f3-a71c-357805683bec" status: 200 len: 1314 microversion: 2.1 time: 0.152179 Sep 20 05:07:12.697202 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 742/892] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:07:12 2022] GET /compute/v2.1/servers/ee2e8d9f-423a-46f3-a71c-357805683bec => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:07:13.157229 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-e9cbd794-1954-4324-915a-7105d09dc5f3 req-548905f2-cdbc-43b9-bfb0-76360c468293 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee2e8d9f-423a-46f3-a71c-357805683bec", "name": "network-vif-plugged", "status": "completed", "tag": "06d0e976-343a-4b0a-881d-734d86ec4bf0"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:07:13.166705 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-e9cbd794-1954-4324-915a-7105d09dc5f3 req-548905f2-cdbc-43b9-bfb0-76360c468293 service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:07:13.167114 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-e9cbd794-1954-4324-915a-7105d09dc5f3 req-548905f2-cdbc-43b9-bfb0-76360c468293 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:07:13.167556 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-e9cbd794-1954-4324-915a-7105d09dc5f3 req-548905f2-cdbc-43b9-bfb0-76360c468293 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:07:13.178774 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-e9cbd794-1954-4324-915a-7105d09dc5f3 req-548905f2-cdbc-43b9-bfb0-76360c468293 service nova] Creating event network-vif-plugged:06d0e976-343a-4b0a-881d-734d86ec4bf0 for instance ee2e8d9f-423a-46f3-a71c-357805683bec on hv-cinder-75671 Sep 20 05:07:13.183640 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-e9cbd794-1954-4324-915a-7105d09dc5f3 req-548905f2-cdbc-43b9-bfb0-76360c468293 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030150 Sep 20 05:07:13.184232 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 743/893] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 05:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 05:07:13.720698 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-d3d07b09-dc68-4abd-8feb-ba04eb26bb0c tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:07:13.721314 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-d3d07b09-dc68-4abd-8feb-ba04eb26bb0c tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] [instance: ee2e8d9f-423a-46f3-a71c-357805683bec] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:07:13.727470 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d3d07b09-dc68-4abd-8feb-ba04eb26bb0c tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:07:13.727942 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d3d07b09-dc68-4abd-8feb-ba04eb26bb0c tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:07:13.728371 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d3d07b09-dc68-4abd-8feb-ba04eb26bb0c tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:07:13.729145 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d3d07b09-dc68-4abd-8feb-ba04eb26bb0c tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:07:13.729595 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d3d07b09-dc68-4abd-8feb-ba04eb26bb0c tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:07:13.730011 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d3d07b09-dc68-4abd-8feb-ba04eb26bb0c tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:07:13.855617 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-d3d07b09-dc68-4abd-8feb-ba04eb26bb0c tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadfd5efee64496d9d9322538fc4cde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975cd6183a57461a9604d14868f48d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:07:13.863341 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-d3d07b09-dc68-4abd-8feb-ba04eb26bb0c tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] 10.222.0.27 "GET /compute/v2.1/servers/ee2e8d9f-423a-46f3-a71c-357805683bec" status: 200 len: 1314 microversion: 2.1 time: 0.147380 Sep 20 05:07:13.863899 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 744/894] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:07:13 2022] GET /compute/v2.1/servers/ee2e8d9f-423a-46f3-a71c-357805683bec => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:07:14.886372 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-d41a54d2-15d8-43e3-995a-81192385d14c tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:07:14.887052 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-d41a54d2-15d8-43e3-995a-81192385d14c tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] [instance: ee2e8d9f-423a-46f3-a71c-357805683bec] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:07:14.890807 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:07:14.895044 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d41a54d2-15d8-43e3-995a-81192385d14c tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:07:14.895516 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d41a54d2-15d8-43e3-995a-81192385d14c tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:07:14.895942 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d41a54d2-15d8-43e3-995a-81192385d14c tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:07:14.896637 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d41a54d2-15d8-43e3-995a-81192385d14c tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:07:14.897087 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d41a54d2-15d8-43e3-995a-81192385d14c tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:07:14.897500 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d41a54d2-15d8-43e3-995a-81192385d14c tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:07:15.028595 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-d41a54d2-15d8-43e3-995a-81192385d14c tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadfd5efee64496d9d9322538fc4cde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975cd6183a57461a9604d14868f48d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:07:15.036256 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-d41a54d2-15d8-43e3-995a-81192385d14c tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] 10.222.0.27 "GET /compute/v2.1/servers/ee2e8d9f-423a-46f3-a71c-357805683bec" status: 200 len: 1498 microversion: 2.1 time: 0.153787 Sep 20 05:07:15.036848 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 745/895] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:07:14 2022] GET /compute/v2.1/servers/ee2e8d9f-423a-46f3-a71c-357805683bec => generated 1498 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:07:15.529688 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-802f7a72-9532-4001-8af4-638ec89dcbdb tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:07:15.530193 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-802f7a72-9532-4001-8af4-638ec89dcbdb tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] [instance: ee2e8d9f-423a-46f3-a71c-357805683bec] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:07:15.536283 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-802f7a72-9532-4001-8af4-638ec89dcbdb tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:07:15.536801 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-802f7a72-9532-4001-8af4-638ec89dcbdb tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:07:15.537238 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-802f7a72-9532-4001-8af4-638ec89dcbdb tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:07:15.537922 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-802f7a72-9532-4001-8af4-638ec89dcbdb tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:07:15.538370 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-802f7a72-9532-4001-8af4-638ec89dcbdb tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:07:15.538819 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-802f7a72-9532-4001-8af4-638ec89dcbdb tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:07:15.565303 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-802f7a72-9532-4001-8af4-638ec89dcbdb tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] [instance: ee2e8d9f-423a-46f3-a71c-357805683bec] Going to try to terminate instance {{(pid=126813) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 20 05:07:15.588720 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell0:SELECT=2 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:07:15.641799 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-802f7a72-9532-4001-8af4-638ec89dcbdb tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ee2e8d9f-423a-46f3-a71c-357805683bec" status: 204 len: 0 microversion: 2.1 time: 0.116277 Sep 20 05:07:15.642382 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 746/896] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Sep 20 05:07:15 2022] DELETE /compute/v2.1/servers/ee2e8d9f-423a-46f3-a71c-357805683bec => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 20 05:07:15.652806 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-56644223-64fa-48d8-9e48-13aff699fad1 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:07:15.653614 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-56644223-64fa-48d8-9e48-13aff699fad1 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] [instance: ee2e8d9f-423a-46f3-a71c-357805683bec] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:07:15.659397 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-56644223-64fa-48d8-9e48-13aff699fad1 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:07:15.659872 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-56644223-64fa-48d8-9e48-13aff699fad1 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:07:15.660302 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-56644223-64fa-48d8-9e48-13aff699fad1 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:07:15.661014 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-56644223-64fa-48d8-9e48-13aff699fad1 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:07:15.661459 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-56644223-64fa-48d8-9e48-13aff699fad1 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:07:15.661896 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-56644223-64fa-48d8-9e48-13aff699fad1 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:07:15.726234 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell0:SELECT=8 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:07:15.788143 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-56644223-64fa-48d8-9e48-13aff699fad1 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadfd5efee64496d9d9322538fc4cde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975cd6183a57461a9604d14868f48d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:07:15.795774 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-56644223-64fa-48d8-9e48-13aff699fad1 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] 10.222.0.27 "GET /compute/v2.1/servers/ee2e8d9f-423a-46f3-a71c-357805683bec" status: 200 len: 1504 microversion: 2.1 time: 0.148690 Sep 20 05:07:15.796326 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 747/897] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:07:15 2022] GET /compute/v2.1/servers/ee2e8d9f-423a-46f3-a71c-357805683bec => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 05:07:16.818361 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-ef3bdf09-8a1e-43c0-8d6b-675a533ab811 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:07:16.819242 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-ef3bdf09-8a1e-43c0-8d6b-675a533ab811 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] [instance: ee2e8d9f-423a-46f3-a71c-357805683bec] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:07:16.825646 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ef3bdf09-8a1e-43c0-8d6b-675a533ab811 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:07:16.826131 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ef3bdf09-8a1e-43c0-8d6b-675a533ab811 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:07:16.826565 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ef3bdf09-8a1e-43c0-8d6b-675a533ab811 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:07:16.827259 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ef3bdf09-8a1e-43c0-8d6b-675a533ab811 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:07:16.827707 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ef3bdf09-8a1e-43c0-8d6b-675a533ab811 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:07:16.828140 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ef3bdf09-8a1e-43c0-8d6b-675a533ab811 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:07:16.963575 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-ef3bdf09-8a1e-43c0-8d6b-675a533ab811 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadfd5efee64496d9d9322538fc4cde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975cd6183a57461a9604d14868f48d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:07:16.971655 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-ef3bdf09-8a1e-43c0-8d6b-675a533ab811 tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] 10.222.0.27 "GET /compute/v2.1/servers/ee2e8d9f-423a-46f3-a71c-357805683bec" status: 200 len: 1504 microversion: 2.1 time: 0.157162 Sep 20 05:07:16.972314 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 748/898] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:07:16 2022] GET /compute/v2.1/servers/ee2e8d9f-423a-46f3-a71c-357805683bec => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:07:17.845003 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-2668a2a6-ed38-483d-92ee-2ea39c6786ec req-126ea912-0a1e-4bee-adcc-3c9ccc2451a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee2e8d9f-423a-46f3-a71c-357805683bec", "name": "network-vif-deleted", "tag": "06d0e976-343a-4b0a-881d-734d86ec4bf0"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:07:17.857185 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-2668a2a6-ed38-483d-92ee-2ea39c6786ec req-126ea912-0a1e-4bee-adcc-3c9ccc2451a5 service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:07:17.857668 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-2668a2a6-ed38-483d-92ee-2ea39c6786ec req-126ea912-0a1e-4bee-adcc-3c9ccc2451a5 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:07:17.858098 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-2668a2a6-ed38-483d-92ee-2ea39c6786ec req-126ea912-0a1e-4bee-adcc-3c9ccc2451a5 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:07:17.869413 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-2668a2a6-ed38-483d-92ee-2ea39c6786ec req-126ea912-0a1e-4bee-adcc-3c9ccc2451a5 service nova] Creating event network-vif-deleted:06d0e976-343a-4b0a-881d-734d86ec4bf0 for instance ee2e8d9f-423a-46f3-a71c-357805683bec on hv-cinder-75671 Sep 20 05:07:17.874507 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-2668a2a6-ed38-483d-92ee-2ea39c6786ec req-126ea912-0a1e-4bee-adcc-3c9ccc2451a5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033641 Sep 20 05:07:17.875104 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 749/899] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 05:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 05:07:17.995525 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-87585fb2-55eb-4880-9c1f-7221c51861ca tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:07:17.996736 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-87585fb2-55eb-4880-9c1f-7221c51861ca tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] [instance: ee2e8d9f-423a-46f3-a71c-357805683bec] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:07:18.003025 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-87585fb2-55eb-4880-9c1f-7221c51861ca tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:07:18.003509 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-87585fb2-55eb-4880-9c1f-7221c51861ca tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:07:18.003944 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-87585fb2-55eb-4880-9c1f-7221c51861ca tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:07:18.004661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-87585fb2-55eb-4880-9c1f-7221c51861ca tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:07:18.005112 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-87585fb2-55eb-4880-9c1f-7221c51861ca tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:07:18.005532 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-87585fb2-55eb-4880-9c1f-7221c51861ca tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:07:18.037752 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-87585fb2-55eb-4880-9c1f-7221c51861ca tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:07:18.038227 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-87585fb2-55eb-4880-9c1f-7221c51861ca tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:07:18.038675 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-87585fb2-55eb-4880-9c1f-7221c51861ca tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:07:18.039134 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.objects.instance [None req-87585fb2-55eb-4880-9c1f-7221c51861ca tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lazy-loading 'fault' on Instance uuid ee2e8d9f-423a-46f3-a71c-357805683bec {{(pid=126813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 05:07:18.082195 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-87585fb2-55eb-4880-9c1f-7221c51861ca tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dadfd5efee64496d9d9322538fc4cde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '975cd6183a57461a9604d14868f48d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:07:18.089907 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-87585fb2-55eb-4880-9c1f-7221c51861ca tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] 10.222.0.27 "GET /compute/v2.1/servers/ee2e8d9f-423a-46f3-a71c-357805683bec" status: 200 len: 1304 microversion: 2.1 time: 0.098563 Sep 20 05:07:18.090459 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 750/900] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:07:17 2022] GET /compute/v2.1/servers/ee2e8d9f-423a-46f3-a71c-357805683bec => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:07:19.112196 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-079252a4-2abf-43d2-84bd-07a3d012563e tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:07:19.112858 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-079252a4-2abf-43d2-84bd-07a3d012563e tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] [instance: ee2e8d9f-423a-46f3-a71c-357805683bec] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:07:19.119162 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-079252a4-2abf-43d2-84bd-07a3d012563e tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:07:19.119666 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-079252a4-2abf-43d2-84bd-07a3d012563e tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:07:19.120094 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-079252a4-2abf-43d2-84bd-07a3d012563e tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:07:19.120876 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-079252a4-2abf-43d2-84bd-07a3d012563e tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:07:19.121324 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-079252a4-2abf-43d2-84bd-07a3d012563e tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:07:19.121743 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-079252a4-2abf-43d2-84bd-07a3d012563e tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:07:19.138119 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.wsgi [None req-079252a4-2abf-43d2-84bd-07a3d012563e tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] HTTP exception thrown: Instance ee2e8d9f-423a-46f3-a71c-357805683bec could not be found. Sep 20 05:07:19.139758 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-079252a4-2abf-43d2-84bd-07a3d012563e tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Request method failure captured: Sep 20 05:07:19.139758 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: request: GET /compute/v2.1/servers/ee2e8d9f-423a-46f3-a71c-357805683bec HTTP/1.1 Sep 20 05:07:19.139758 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept: application/json Sep 20 05:07:19.139758 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept-Encoding: identity Sep 20 05:07:19.139758 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Connection: close Sep 20 05:07:19.139758 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Length: 0 Sep 20 05:07:19.139758 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Type: application/json Sep 20 05:07:19.139758 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Host: 10.222.0.27 Sep 20 05:07:19.139758 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Openstack-System-Scope: None Sep 20 05:07:19.139758 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: User-Agent: python-urllib3/1.26.12 Sep 20 05:07:19.139758 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Auth-Token: gAAAAABjKUpp0OuPs03agpvFoN71wzcyWdvHFLTFUxQDaVrAIrb3gWM7wW-ddBSqVyWVGfYSUguhp7sIeEgVcQhPOk80NfQb10nKgmaoEhCbxR8J2FShYbbAq6h7pbLCIZfxyDXygSE41vTMBKv4G4nJVOyYmeR_olGekhjWInw0dKeL6g45UGM Sep 20 05:07:19.139758 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Id: None Sep 20 05:07:19.139758 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Name: None Sep 20 05:07:19.139758 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Identity-Status: Confirmed Sep 20 05:07:19.139758 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Is-Admin-Project: True Sep 20 05:07:19.139758 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Id: default Sep 20 05:07:19.139758 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Name: Default Sep 20 05:07:19.139758 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Id: 975cd6183a57461a9604d14868f48d6f Sep 20 05:07:19.139758 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Name: tempest-VolumesActionsTest-1338137131 Sep 20 05:07:19.139758 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Role: reader,member Sep 20 05:07:19.139758 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Roles: reader,member Sep 20 05:07:19.141388 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/975cd6183a57461a9604d14868f48d6f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/975cd6183a57461a9604d14868f48d6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_975cd6183a57461a9604d14868f48d6f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/975cd6183a57461a9604d14868f48d6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 05:07:19.141388 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant: tempest-VolumesActionsTest-1338137131 Sep 20 05:07:19.141388 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Id: 975cd6183a57461a9604d14868f48d6f Sep 20 05:07:19.141388 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Name: tempest-VolumesActionsTest-1338137131 Sep 20 05:07:19.141388 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User: tempest-VolumesActionsTest-1338137131-project Sep 20 05:07:19.141388 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Id: default Sep 20 05:07:19.141388 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Name: Default Sep 20 05:07:19.141388 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Id: dadfd5efee64496d9d9322538fc4cde3 Sep 20 05:07:19.141388 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Name: tempest-VolumesActionsTest-1338137131-project Sep 20 05:07:19.141388 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: method: > Sep 20 05:07:19.141388 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: exception: Instance ee2e8d9f-423a-46f3-a71c-357805683bec could not be found. Sep 20 05:07:19.141388 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: action_args: {'id': 'ee2e8d9f-423a-46f3-a71c-357805683bec'} Sep 20 05:07:19.142318 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 05:07:19.142318 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:07:19.142318 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 05:07:19.142318 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 05:07:19.142318 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 05:07:19.142318 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 05:07:19.142318 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 05:07:19.142318 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 05:07:19.142318 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 05:07:19.142318 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 05:07:19.142318 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee2e8d9f-423a-46f3-a71c-357805683bec could not be found. Sep 20 05:07:19.142318 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:07:19.142318 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 05:07:19.142318 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:07:19.142318 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:07:19.142318 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 05:07:19.142318 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 05:07:19.142318 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 05:07:19.142318 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 05:07:19.142318 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 05:07:19.143657 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 05:07:19.143657 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 05:07:19.143657 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 05:07:19.143657 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 05:07:19.143657 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 05:07:19.143657 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 05:07:19.143657 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 05:07:19.143657 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee2e8d9f-423a-46f3-a71c-357805683bec could not be found. Sep 20 05:07:19.143657 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:07:19.143657 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 05:07:19.143657 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:07:19.143657 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:07:19.143657 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 05:07:19.143657 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 05:07:19.143657 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 05:07:19.143657 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 05:07:19.143657 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee2e8d9f-423a-46f3-a71c-357805683bec could not be found. Sep 20 05:07:19.143657 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:07:19.145145 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-079252a4-2abf-43d2-84bd-07a3d012563e tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] Returning 404 to user: Instance ee2e8d9f-423a-46f3-a71c-357805683bec could not be found. {{(pid=126813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 05:07:19.145145 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-079252a4-2abf-43d2-84bd-07a3d012563e tempest-VolumesActionsTest-1338137131 tempest-VolumesActionsTest-1338137131-project] 10.222.0.27 "GET /compute/v2.1/servers/ee2e8d9f-423a-46f3-a71c-357805683bec" status: 404 len: 111 microversion: 2.1 time: 0.032754 Sep 20 05:07:19.145145 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 751/901] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:07:19 2022] GET /compute/v2.1/servers/ee2e8d9f-423a-46f3-a71c-357805683bec => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 20 05:07:19.255236 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 20 05:07:19.255737 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: Tue Sep 20 05:07:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.27) !!! Sep 20 05:07:39.694285 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 20 05:07:39.694855 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: Tue Sep 20 05:07:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.27) !!! Sep 20 05:08:00.445379 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-f9c77982-ebc7-40ec-900f-840644b9a9b3 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Action: 'create', calling method: .version_select at 0x7f2e4a46d4c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1813333039", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPDAsIUnMFVkF6Ize3GAkTbfQrEO3xpFvcOuJqA2capc0NmiaCfRTwW9jXE3UzDe1KtcWzDBPm+WE8cuIuJ/mTnt4LngizanmIvXkrCeErzktpEn5Y95Rg9rCDClCtpWTw=="}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:08:00.451707 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:08:00.452363 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:08:00.468490 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-f9c77982-ebc7-40ec-900f-840644b9a9b3 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Getting quotas for project 15e8eefa98f44e8a871402c07adf11cf. Resources: {'key_pairs'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 05:08:00.472345 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-f9c77982-ebc7-40ec-900f-840644b9a9b3 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Getting quotas for user cec291933cb14a0b8d6f8db32dbbe4b0 and project 15e8eefa98f44e8a871402c07adf11cf. Resources: {'key_pairs'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 05:08:00.493304 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-f9c77982-ebc7-40ec-900f-840644b9a9b3 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.052045 Sep 20 05:08:00.493887 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 752/902] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Sep 20 05:08:00 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 05:08:00.545138 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-433504b8-c24e-41e4-88f4-b15b999a924a tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1727371857", "imageRef": "69a95fbf-790f-4920-bf05-43d0dedec236", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1813333039", "networks": [{"uuid": "5a22d9ec-5b75-4df5-bab1-9104cd60cbe5"}]}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:08:00.719937 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.network.neutron [None req-433504b8-c24e-41e4-88f4-b15b999a924a tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] validate_networks() for [('5a22d9ec-5b75-4df5-bab1-9104cd60cbe5', None, None, None, None, None)] {{(pid=126813) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 20 05:08:01.173329 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-433504b8-c24e-41e4-88f4-b15b999a924a tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Flavor limits 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 20 05:08:01.173751 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-433504b8-c24e-41e4-88f4-b15b999a924a tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Image limits 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 20 05:08:01.174217 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-433504b8-c24e-41e4-88f4-b15b999a924a tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Flavor pref 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 20 05:08:01.174619 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-433504b8-c24e-41e4-88f4-b15b999a924a tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Image pref 0:0:0 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 20 05:08:01.175025 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.virt.hardware [None req-433504b8-c24e-41e4-88f4-b15b999a924a tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126813) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 20 05:08:01.184039 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-433504b8-c24e-41e4-88f4-b15b999a924a tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:01.184516 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-433504b8-c24e-41e4-88f4-b15b999a924a tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:01.184980 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-433504b8-c24e-41e4-88f4-b15b999a924a tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:01.185697 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-433504b8-c24e-41e4-88f4-b15b999a924a tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:01.186144 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-433504b8-c24e-41e4-88f4-b15b999a924a tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:01.186574 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-433504b8-c24e-41e4-88f4-b15b999a924a tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:01.203216 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-433504b8-c24e-41e4-88f4-b15b999a924a tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Getting quotas for project 15e8eefa98f44e8a871402c07adf11cf. Resources: {'ram', 'cores', 'instances'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 05:08:01.207206 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.quota [None req-433504b8-c24e-41e4-88f4-b15b999a924a tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Getting quotas for user cec291933cb14a0b8d6f8db32dbbe4b0 and project 15e8eefa98f44e8a871402c07adf11cf. Resources: {'ram', 'cores', 'instances'} {{(pid=126813) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 05:08:01.218541 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-433504b8-c24e-41e4-88f4-b15b999a924a tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Going to run 1 instances... {{(pid=126813) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 20 05:08:01.220761 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-433504b8-c24e-41e4-88f4-b15b999a924a tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] [instance: c57336b7-0747-4ad8-81bb-4f20fbfaa545] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69a95fbf-790f-4920-bf05-43d0dedec236',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126813) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 20 05:08:01.264750 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-433504b8-c24e-41e4-88f4-b15b999a924a tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.723394 Sep 20 05:08:01.265404 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 753/903] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Sep 20 05:08:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 20 05:08:01.276061 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-225da0c0-3113-41a6-8390-cbb4826be8eb tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:08:01.277328 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-225da0c0-3113-41a6-8390-cbb4826be8eb tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] [instance: c57336b7-0747-4ad8-81bb-4f20fbfaa545] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:08:01.330500 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-225da0c0-3113-41a6-8390-cbb4826be8eb tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec291933cb14a0b8d6f8db32dbbe4b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e8eefa98f44e8a871402c07adf11cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:08:01.337599 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-225da0c0-3113-41a6-8390-cbb4826be8eb tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] 10.222.0.27 "GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545" status: 200 len: 1259 microversion: 2.1 time: 0.065149 Sep 20 05:08:01.338195 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 754/904] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:08:01 2022] GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545 => generated 1259 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:08:02.361048 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-e8b4f3ba-04bf-4c6c-a736-c6b4671e2a02 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:08:02.361690 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-e8b4f3ba-04bf-4c6c-a736-c6b4671e2a02 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] [instance: c57336b7-0747-4ad8-81bb-4f20fbfaa545] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:08:02.368122 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e8b4f3ba-04bf-4c6c-a736-c6b4671e2a02 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:02.368902 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e8b4f3ba-04bf-4c6c-a736-c6b4671e2a02 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:02.369328 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e8b4f3ba-04bf-4c6c-a736-c6b4671e2a02 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:02.369850 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e8b4f3ba-04bf-4c6c-a736-c6b4671e2a02 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:02.370608 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e8b4f3ba-04bf-4c6c-a736-c6b4671e2a02 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:02.370745 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e8b4f3ba-04bf-4c6c-a736-c6b4671e2a02 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:02.439822 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-e8b4f3ba-04bf-4c6c-a736-c6b4671e2a02 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec291933cb14a0b8d6f8db32dbbe4b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e8eefa98f44e8a871402c07adf11cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:08:02.447774 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-e8b4f3ba-04bf-4c6c-a736-c6b4671e2a02 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] 10.222.0.27 "GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545" status: 200 len: 1319 microversion: 2.1 time: 0.090584 Sep 20 05:08:02.460622 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 755/905] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:08:02 2022] GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545 => generated 1319 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:08:03.471535 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-6bbc0697-12b5-49bf-9046-b23ada66b922 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:08:03.472194 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-6bbc0697-12b5-49bf-9046-b23ada66b922 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] [instance: c57336b7-0747-4ad8-81bb-4f20fbfaa545] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:08:03.478803 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6bbc0697-12b5-49bf-9046-b23ada66b922 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:03.479342 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6bbc0697-12b5-49bf-9046-b23ada66b922 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:03.479775 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6bbc0697-12b5-49bf-9046-b23ada66b922 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:03.480460 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6bbc0697-12b5-49bf-9046-b23ada66b922 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:03.481100 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6bbc0697-12b5-49bf-9046-b23ada66b922 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:03.481527 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6bbc0697-12b5-49bf-9046-b23ada66b922 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:03.627477 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-6bbc0697-12b5-49bf-9046-b23ada66b922 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec291933cb14a0b8d6f8db32dbbe4b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e8eefa98f44e8a871402c07adf11cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:08:03.638356 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-6bbc0697-12b5-49bf-9046-b23ada66b922 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] 10.222.0.27 "GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545" status: 200 len: 1359 microversion: 2.1 time: 0.170583 Sep 20 05:08:03.639726 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 756/906] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:08:03 2022] GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:08:04.664018 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-42068698-f7bc-41d9-b267-f41aa3c330f0 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:08:04.664720 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-42068698-f7bc-41d9-b267-f41aa3c330f0 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] [instance: c57336b7-0747-4ad8-81bb-4f20fbfaa545] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:08:04.672036 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-42068698-f7bc-41d9-b267-f41aa3c330f0 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:04.672036 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-42068698-f7bc-41d9-b267-f41aa3c330f0 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:04.672332 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-42068698-f7bc-41d9-b267-f41aa3c330f0 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:04.672891 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-42068698-f7bc-41d9-b267-f41aa3c330f0 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:04.673349 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-42068698-f7bc-41d9-b267-f41aa3c330f0 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:04.673776 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-42068698-f7bc-41d9-b267-f41aa3c330f0 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:04.815720 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-42068698-f7bc-41d9-b267-f41aa3c330f0 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec291933cb14a0b8d6f8db32dbbe4b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e8eefa98f44e8a871402c07adf11cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:08:04.823652 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-42068698-f7bc-41d9-b267-f41aa3c330f0 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] 10.222.0.27 "GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545" status: 200 len: 1359 microversion: 2.1 time: 0.164950 Sep 20 05:08:04.824463 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 757/907] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:08:04 2022] GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:08:05.846435 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-4340337f-3646-4387-bbd0-23e28642a7d0 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:08:05.847087 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-4340337f-3646-4387-bbd0-23e28642a7d0 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] [instance: c57336b7-0747-4ad8-81bb-4f20fbfaa545] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:08:05.853975 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4340337f-3646-4387-bbd0-23e28642a7d0 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:05.855253 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4340337f-3646-4387-bbd0-23e28642a7d0 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:05.855906 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4340337f-3646-4387-bbd0-23e28642a7d0 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:05.857044 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4340337f-3646-4387-bbd0-23e28642a7d0 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:05.857723 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4340337f-3646-4387-bbd0-23e28642a7d0 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:05.858367 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4340337f-3646-4387-bbd0-23e28642a7d0 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:05.999929 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-4340337f-3646-4387-bbd0-23e28642a7d0 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec291933cb14a0b8d6f8db32dbbe4b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e8eefa98f44e8a871402c07adf11cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:08:06.008403 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-4340337f-3646-4387-bbd0-23e28642a7d0 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] 10.222.0.27 "GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545" status: 200 len: 1359 microversion: 2.1 time: 0.165931 Sep 20 05:08:06.009923 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 758/908] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:08:05 2022] GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:08:07.031850 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-4b32747f-afc0-4317-9216-44c67e04ac34 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:08:07.032501 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-4b32747f-afc0-4317-9216-44c67e04ac34 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] [instance: c57336b7-0747-4ad8-81bb-4f20fbfaa545] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:08:07.039088 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4b32747f-afc0-4317-9216-44c67e04ac34 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:07.039661 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4b32747f-afc0-4317-9216-44c67e04ac34 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:07.040163 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4b32747f-afc0-4317-9216-44c67e04ac34 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:07.041004 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4b32747f-afc0-4317-9216-44c67e04ac34 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:07.041520 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4b32747f-afc0-4317-9216-44c67e04ac34 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:07.042609 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4b32747f-afc0-4317-9216-44c67e04ac34 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:07.183104 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-4b32747f-afc0-4317-9216-44c67e04ac34 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec291933cb14a0b8d6f8db32dbbe4b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e8eefa98f44e8a871402c07adf11cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:08:07.190892 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-4b32747f-afc0-4317-9216-44c67e04ac34 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] 10.222.0.27 "GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545" status: 200 len: 1359 microversion: 2.1 time: 0.163032 Sep 20 05:08:07.191464 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 759/909] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:08:07 2022] GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:08:08.213854 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-ca0d7edb-b161-4ad9-af88-c0afaf4ce82f tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:08:08.214827 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-ca0d7edb-b161-4ad9-af88-c0afaf4ce82f tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] [instance: c57336b7-0747-4ad8-81bb-4f20fbfaa545] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:08:08.223823 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ca0d7edb-b161-4ad9-af88-c0afaf4ce82f tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:08.224309 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ca0d7edb-b161-4ad9-af88-c0afaf4ce82f tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:08.224774 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ca0d7edb-b161-4ad9-af88-c0afaf4ce82f tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:08.225478 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ca0d7edb-b161-4ad9-af88-c0afaf4ce82f tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:08.225926 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ca0d7edb-b161-4ad9-af88-c0afaf4ce82f tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:08.226351 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ca0d7edb-b161-4ad9-af88-c0afaf4ce82f tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:08.380364 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-ca0d7edb-b161-4ad9-af88-c0afaf4ce82f tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec291933cb14a0b8d6f8db32dbbe4b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e8eefa98f44e8a871402c07adf11cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:08:08.391390 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-ca0d7edb-b161-4ad9-af88-c0afaf4ce82f tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] 10.222.0.27 "GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545" status: 200 len: 1359 microversion: 2.1 time: 0.181511 Sep 20 05:08:08.392481 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 760/910] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:08:08 2022] GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545 => generated 1359 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:08:09.414758 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-accc6d54-97ab-463f-befa-d1642bc79966 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:08:09.415425 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-accc6d54-97ab-463f-befa-d1642bc79966 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] [instance: c57336b7-0747-4ad8-81bb-4f20fbfaa545] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:08:09.423486 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-accc6d54-97ab-463f-befa-d1642bc79966 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:09.424188 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-accc6d54-97ab-463f-befa-d1642bc79966 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:09.424985 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-accc6d54-97ab-463f-befa-d1642bc79966 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:09.425740 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-accc6d54-97ab-463f-befa-d1642bc79966 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:09.426229 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-accc6d54-97ab-463f-befa-d1642bc79966 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:09.426629 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-accc6d54-97ab-463f-befa-d1642bc79966 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:09.578998 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-accc6d54-97ab-463f-befa-d1642bc79966 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec291933cb14a0b8d6f8db32dbbe4b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e8eefa98f44e8a871402c07adf11cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:08:09.587168 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-accc6d54-97ab-463f-befa-d1642bc79966 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] 10.222.0.27 "GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545" status: 200 len: 1359 microversion: 2.1 time: 0.176390 Sep 20 05:08:09.587729 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 761/911] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:08:09 2022] GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545 => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:08:10.611464 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-2778ee01-a16a-48b0-8818-1bb2db906636 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:08:10.612198 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-2778ee01-a16a-48b0-8818-1bb2db906636 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] [instance: c57336b7-0747-4ad8-81bb-4f20fbfaa545] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:08:10.618540 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2778ee01-a16a-48b0-8818-1bb2db906636 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:10.619016 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2778ee01-a16a-48b0-8818-1bb2db906636 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:10.619444 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2778ee01-a16a-48b0-8818-1bb2db906636 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:10.620684 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2778ee01-a16a-48b0-8818-1bb2db906636 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:10.621136 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2778ee01-a16a-48b0-8818-1bb2db906636 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:10.621697 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2778ee01-a16a-48b0-8818-1bb2db906636 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:10.752014 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-2778ee01-a16a-48b0-8818-1bb2db906636 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec291933cb14a0b8d6f8db32dbbe4b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e8eefa98f44e8a871402c07adf11cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:08:10.759785 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-2778ee01-a16a-48b0-8818-1bb2db906636 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] 10.222.0.27 "GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545" status: 200 len: 1359 microversion: 2.1 time: 0.152244 Sep 20 05:08:10.760927 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 762/912] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:08:10 2022] GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:08:11.290836 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell0:SELECT=2 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:08:11.334885 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell0:SELECT=12 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:08:11.361300 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-bf8d97af-93d7-4182-a559-cd4abeb18d60 req-e423c61d-ce6d-4f6d-b35e-6f91542c0448 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c57336b7-0747-4ad8-81bb-4f20fbfaa545", "tag": "9ae9a161-04f7-400c-a3d0-5448b4be5410"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:08:11.370708 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-bf8d97af-93d7-4182-a559-cd4abeb18d60 req-e423c61d-ce6d-4f6d-b35e-6f91542c0448 service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:11.371183 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-bf8d97af-93d7-4182-a559-cd4abeb18d60 req-e423c61d-ce6d-4f6d-b35e-6f91542c0448 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:11.371608 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-bf8d97af-93d7-4182-a559-cd4abeb18d60 req-e423c61d-ce6d-4f6d-b35e-6f91542c0448 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:11.382622 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-bf8d97af-93d7-4182-a559-cd4abeb18d60 req-e423c61d-ce6d-4f6d-b35e-6f91542c0448 service nova] Creating event network-changed:9ae9a161-04f7-400c-a3d0-5448b4be5410 for instance c57336b7-0747-4ad8-81bb-4f20fbfaa545 on hv-cinder-75671 Sep 20 05:08:11.387622 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-bf8d97af-93d7-4182-a559-cd4abeb18d60 req-e423c61d-ce6d-4f6d-b35e-6f91542c0448 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101995 Sep 20 05:08:11.388204 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 763/913] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 05:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 05:08:11.784041 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-d849a522-26c5-4be4-9d65-7ddf089675d7 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:08:11.784813 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-d849a522-26c5-4be4-9d65-7ddf089675d7 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] [instance: c57336b7-0747-4ad8-81bb-4f20fbfaa545] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:08:11.791239 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d849a522-26c5-4be4-9d65-7ddf089675d7 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:11.791718 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d849a522-26c5-4be4-9d65-7ddf089675d7 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:11.792209 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d849a522-26c5-4be4-9d65-7ddf089675d7 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:11.792922 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d849a522-26c5-4be4-9d65-7ddf089675d7 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:11.793367 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d849a522-26c5-4be4-9d65-7ddf089675d7 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:11.793786 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d849a522-26c5-4be4-9d65-7ddf089675d7 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:11.923850 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-d849a522-26c5-4be4-9d65-7ddf089675d7 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec291933cb14a0b8d6f8db32dbbe4b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e8eefa98f44e8a871402c07adf11cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:08:11.931636 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-d849a522-26c5-4be4-9d65-7ddf089675d7 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] 10.222.0.27 "GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545" status: 200 len: 1359 microversion: 2.1 time: 0.152182 Sep 20 05:08:11.932711 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 764/914] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:08:11 2022] GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:08:12.954819 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-390ced9e-bbb5-4fb3-a19d-039ba291d309 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:08:12.955517 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-390ced9e-bbb5-4fb3-a19d-039ba291d309 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] [instance: c57336b7-0747-4ad8-81bb-4f20fbfaa545] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:08:12.961896 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-390ced9e-bbb5-4fb3-a19d-039ba291d309 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:12.962375 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-390ced9e-bbb5-4fb3-a19d-039ba291d309 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:12.962810 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-390ced9e-bbb5-4fb3-a19d-039ba291d309 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:12.963986 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-390ced9e-bbb5-4fb3-a19d-039ba291d309 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:12.964438 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-390ced9e-bbb5-4fb3-a19d-039ba291d309 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:12.964887 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-390ced9e-bbb5-4fb3-a19d-039ba291d309 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:13.089919 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-390ced9e-bbb5-4fb3-a19d-039ba291d309 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec291933cb14a0b8d6f8db32dbbe4b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e8eefa98f44e8a871402c07adf11cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:08:13.097578 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-390ced9e-bbb5-4fb3-a19d-039ba291d309 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] 10.222.0.27 "GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545" status: 200 len: 1359 microversion: 2.1 time: 0.146701 Sep 20 05:08:13.098141 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 765/915] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:08:12 2022] GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545 => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:08:14.119168 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-0e96360e-e615-49aa-8985-e8952a361adf tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:08:14.120448 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-0e96360e-e615-49aa-8985-e8952a361adf tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] [instance: c57336b7-0747-4ad8-81bb-4f20fbfaa545] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:08:14.126878 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0e96360e-e615-49aa-8985-e8952a361adf tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:14.127385 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0e96360e-e615-49aa-8985-e8952a361adf tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:14.132289 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0e96360e-e615-49aa-8985-e8952a361adf tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:14.132289 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0e96360e-e615-49aa-8985-e8952a361adf tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:14.132289 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0e96360e-e615-49aa-8985-e8952a361adf tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:14.132289 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-0e96360e-e615-49aa-8985-e8952a361adf tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:14.256769 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-0e96360e-e615-49aa-8985-e8952a361adf tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec291933cb14a0b8d6f8db32dbbe4b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e8eefa98f44e8a871402c07adf11cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:08:14.264378 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-0e96360e-e615-49aa-8985-e8952a361adf tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] 10.222.0.27 "GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545" status: 200 len: 1359 microversion: 2.1 time: 0.149058 Sep 20 05:08:14.264976 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 766/916] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:08:14 2022] GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:08:15.287541 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-7fa6b9fe-b0f3-4309-a2cb-da2133b6c3b6 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:08:15.288198 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-7fa6b9fe-b0f3-4309-a2cb-da2133b6c3b6 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] [instance: c57336b7-0747-4ad8-81bb-4f20fbfaa545] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:08:15.295293 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7fa6b9fe-b0f3-4309-a2cb-da2133b6c3b6 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:15.295769 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7fa6b9fe-b0f3-4309-a2cb-da2133b6c3b6 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:15.296201 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7fa6b9fe-b0f3-4309-a2cb-da2133b6c3b6 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:15.296920 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7fa6b9fe-b0f3-4309-a2cb-da2133b6c3b6 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:15.297368 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7fa6b9fe-b0f3-4309-a2cb-da2133b6c3b6 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:15.297786 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7fa6b9fe-b0f3-4309-a2cb-da2133b6c3b6 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:15.425327 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-7fa6b9fe-b0f3-4309-a2cb-da2133b6c3b6 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec291933cb14a0b8d6f8db32dbbe4b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e8eefa98f44e8a871402c07adf11cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:08:15.433955 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-7fa6b9fe-b0f3-4309-a2cb-da2133b6c3b6 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] 10.222.0.27 "GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545" status: 200 len: 1359 microversion: 2.1 time: 0.150219 Sep 20 05:08:15.434724 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 767/917] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:08:15 2022] GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:08:16.456847 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-2c82ded9-4aed-4292-9528-228aae8b57b0 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:08:16.457491 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-2c82ded9-4aed-4292-9528-228aae8b57b0 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] [instance: c57336b7-0747-4ad8-81bb-4f20fbfaa545] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:08:16.463830 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2c82ded9-4aed-4292-9528-228aae8b57b0 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:16.464310 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2c82ded9-4aed-4292-9528-228aae8b57b0 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:16.464788 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2c82ded9-4aed-4292-9528-228aae8b57b0 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:16.465474 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2c82ded9-4aed-4292-9528-228aae8b57b0 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:16.465922 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2c82ded9-4aed-4292-9528-228aae8b57b0 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:16.466347 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2c82ded9-4aed-4292-9528-228aae8b57b0 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:16.594281 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-2c82ded9-4aed-4292-9528-228aae8b57b0 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec291933cb14a0b8d6f8db32dbbe4b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e8eefa98f44e8a871402c07adf11cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:08:16.601995 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-2c82ded9-4aed-4292-9528-228aae8b57b0 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] 10.222.0.27 "GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545" status: 200 len: 1359 microversion: 2.1 time: 0.149212 Sep 20 05:08:16.602555 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 768/918] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:08:16 2022] GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:08:17.478640 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-95c409da-7464-452b-88ec-a1bb69d689f6 req-0678de06-dd31-4c80-b430-fc2d9fef1119 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c57336b7-0747-4ad8-81bb-4f20fbfaa545", "name": "network-vif-plugged", "status": "completed", "tag": "9ae9a161-04f7-400c-a3d0-5448b4be5410"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:08:17.488147 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-95c409da-7464-452b-88ec-a1bb69d689f6 req-0678de06-dd31-4c80-b430-fc2d9fef1119 service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:17.488654 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-95c409da-7464-452b-88ec-a1bb69d689f6 req-0678de06-dd31-4c80-b430-fc2d9fef1119 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:17.489091 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-95c409da-7464-452b-88ec-a1bb69d689f6 req-0678de06-dd31-4c80-b430-fc2d9fef1119 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:17.500749 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-95c409da-7464-452b-88ec-a1bb69d689f6 req-0678de06-dd31-4c80-b430-fc2d9fef1119 service nova] Creating event network-vif-plugged:9ae9a161-04f7-400c-a3d0-5448b4be5410 for instance c57336b7-0747-4ad8-81bb-4f20fbfaa545 on hv-cinder-75671 Sep 20 05:08:17.506356 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-95c409da-7464-452b-88ec-a1bb69d689f6 req-0678de06-dd31-4c80-b430-fc2d9fef1119 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087878 Sep 20 05:08:17.507045 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 769/919] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 05:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 05:08:17.625761 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-7890c1d7-5470-4ec8-9902-096f01892da6 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:08:17.626602 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-7890c1d7-5470-4ec8-9902-096f01892da6 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] [instance: c57336b7-0747-4ad8-81bb-4f20fbfaa545] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:08:17.632939 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7890c1d7-5470-4ec8-9902-096f01892da6 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:17.633423 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7890c1d7-5470-4ec8-9902-096f01892da6 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:17.633982 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7890c1d7-5470-4ec8-9902-096f01892da6 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:17.634630 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7890c1d7-5470-4ec8-9902-096f01892da6 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:17.635204 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7890c1d7-5470-4ec8-9902-096f01892da6 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:17.635630 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-7890c1d7-5470-4ec8-9902-096f01892da6 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:17.763886 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-7890c1d7-5470-4ec8-9902-096f01892da6 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec291933cb14a0b8d6f8db32dbbe4b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e8eefa98f44e8a871402c07adf11cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:08:17.771919 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-7890c1d7-5470-4ec8-9902-096f01892da6 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] 10.222.0.27 "GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545" status: 200 len: 1359 microversion: 2.1 time: 0.150393 Sep 20 05:08:17.772479 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 770/920] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:08:17 2022] GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 05:08:18.794655 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-f207cf7d-4d94-4289-950f-d8757eb27346 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:08:18.795343 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-f207cf7d-4d94-4289-950f-d8757eb27346 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] [instance: c57336b7-0747-4ad8-81bb-4f20fbfaa545] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:08:18.801720 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f207cf7d-4d94-4289-950f-d8757eb27346 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:18.802204 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f207cf7d-4d94-4289-950f-d8757eb27346 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:18.802643 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f207cf7d-4d94-4289-950f-d8757eb27346 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:18.803327 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f207cf7d-4d94-4289-950f-d8757eb27346 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:18.803776 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f207cf7d-4d94-4289-950f-d8757eb27346 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:18.804198 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-f207cf7d-4d94-4289-950f-d8757eb27346 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:18.932809 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-f207cf7d-4d94-4289-950f-d8757eb27346 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec291933cb14a0b8d6f8db32dbbe4b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e8eefa98f44e8a871402c07adf11cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:08:18.940581 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-f207cf7d-4d94-4289-950f-d8757eb27346 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] 10.222.0.27 "GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545" status: 200 len: 1550 microversion: 2.1 time: 0.149748 Sep 20 05:08:18.941148 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 771/921] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:08:18 2022] GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545 => generated 1550 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:08:18.961614 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-a40745ab-01b6-49a8-b2e3-3162370cb383 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:08:18.962225 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-a40745ab-01b6-49a8-b2e3-3162370cb383 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] [instance: c57336b7-0747-4ad8-81bb-4f20fbfaa545] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:08:18.968373 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a40745ab-01b6-49a8-b2e3-3162370cb383 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:18.968881 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a40745ab-01b6-49a8-b2e3-3162370cb383 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:18.969318 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a40745ab-01b6-49a8-b2e3-3162370cb383 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:18.969999 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a40745ab-01b6-49a8-b2e3-3162370cb383 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:18.970447 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a40745ab-01b6-49a8-b2e3-3162370cb383 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:18.970871 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a40745ab-01b6-49a8-b2e3-3162370cb383 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:18.989179 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell1:SELECT=100 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:08:19.101530 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-a40745ab-01b6-49a8-b2e3-3162370cb383 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec291933cb14a0b8d6f8db32dbbe4b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e8eefa98f44e8a871402c07adf11cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:08:19.109640 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-a40745ab-01b6-49a8-b2e3-3162370cb383 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] 10.222.0.27 "GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545" status: 200 len: 1550 microversion: 2.1 time: 0.151481 Sep 20 05:08:19.110226 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 772/922] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:08:18 2022] GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545 => generated 1550 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:08:19.130944 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-e03e923a-138b-4229-afac-0e5fc713b38e tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:08:19.136534 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-e03e923a-138b-4229-afac-0e5fc713b38e tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cec291933cb14a0b8d6f8db32dbbe4b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e8eefa98f44e8a871402c07adf11cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:08:19.137349 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-e03e923a-138b-4229-afac-0e5fc713b38e tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Searching by: {'deleted': False, 'project_id': '15e8eefa98f44e8a871402c07adf11cf'} {{(pid=126813) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 20 05:08:19.144018 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e03e923a-138b-4229-afac-0e5fc713b38e tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:19.144496 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e03e923a-138b-4229-afac-0e5fc713b38e tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:19.144979 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e03e923a-138b-4229-afac-0e5fc713b38e tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:19.145708 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e03e923a-138b-4229-afac-0e5fc713b38e tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:19.146415 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e03e923a-138b-4229-afac-0e5fc713b38e tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:19.146840 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e03e923a-138b-4229-afac-0e5fc713b38e tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:19.238339 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.multi_cell_list [None req-e03e923a-138b-4229-afac-0e5fc713b38e tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126813) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 20 05:08:19.330044 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-e03e923a-138b-4229-afac-0e5fc713b38e tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.202843 Sep 20 05:08:19.330544 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 773/923] 10.222.0.27 () {58 vars in 1125 bytes} [Tue Sep 20 05:08:19 2022] GET /compute/v2.1/servers => generated 343 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 05:08:19.342610 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-ba10caed-9c4a-4a80-9697-0575ccf65c4b tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:08:19.343212 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-ba10caed-9c4a-4a80-9697-0575ccf65c4b tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] [instance: c57336b7-0747-4ad8-81bb-4f20fbfaa545] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:08:19.348787 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ba10caed-9c4a-4a80-9697-0575ccf65c4b tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:19.349263 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ba10caed-9c4a-4a80-9697-0575ccf65c4b tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:19.349690 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ba10caed-9c4a-4a80-9697-0575ccf65c4b tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:19.350364 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ba10caed-9c4a-4a80-9697-0575ccf65c4b tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:19.350808 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ba10caed-9c4a-4a80-9697-0575ccf65c4b tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:19.351229 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-ba10caed-9c4a-4a80-9697-0575ccf65c4b tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:19.474865 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-ba10caed-9c4a-4a80-9697-0575ccf65c4b tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec291933cb14a0b8d6f8db32dbbe4b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e8eefa98f44e8a871402c07adf11cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:08:19.482482 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-ba10caed-9c4a-4a80-9697-0575ccf65c4b tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] 10.222.0.27 "GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545" status: 200 len: 1550 microversion: 2.1 time: 0.143963 Sep 20 05:08:19.483052 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 774/924] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:08:19 2022] GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545 => generated 1550 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:08:21.017595 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-d7ef65ba-e80e-4517-b8dc-f118c32d6f28 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1d468c92-9b12-4544-8773-3ce604f02da0"}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:08:21.019900 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-d7ef65ba-e80e-4517-b8dc-f118c32d6f28 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] [instance: c57336b7-0747-4ad8-81bb-4f20fbfaa545] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:08:21.027015 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d7ef65ba-e80e-4517-b8dc-f118c32d6f28 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:21.027499 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d7ef65ba-e80e-4517-b8dc-f118c32d6f28 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:21.027935 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d7ef65ba-e80e-4517-b8dc-f118c32d6f28 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:21.028635 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d7ef65ba-e80e-4517-b8dc-f118c32d6f28 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:21.029092 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d7ef65ba-e80e-4517-b8dc-f118c32d6f28 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:21.029519 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d7ef65ba-e80e-4517-b8dc-f118c32d6f28 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:21.293795 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-d7ef65ba-e80e-4517-b8dc-f118c32d6f28 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] 10.222.0.27 "POST /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279896 Sep 20 05:08:21.294704 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 775/925] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Sep 20 05:08:21 2022] POST /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 05:08:27.824512 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-43ef96fb-d9a4-4911-8c5f-da4bb0ca4c53 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:08:27.825246 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-43ef96fb-d9a4-4911-8c5f-da4bb0ca4c53 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] [instance: c57336b7-0747-4ad8-81bb-4f20fbfaa545] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:08:27.832040 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-43ef96fb-d9a4-4911-8c5f-da4bb0ca4c53 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:27.832531 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-43ef96fb-d9a4-4911-8c5f-da4bb0ca4c53 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:27.833003 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-43ef96fb-d9a4-4911-8c5f-da4bb0ca4c53 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:27.833698 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-43ef96fb-d9a4-4911-8c5f-da4bb0ca4c53 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:27.834153 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-43ef96fb-d9a4-4911-8c5f-da4bb0ca4c53 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:27.834584 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-43ef96fb-d9a4-4911-8c5f-da4bb0ca4c53 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:27.966720 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-43ef96fb-d9a4-4911-8c5f-da4bb0ca4c53 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec291933cb14a0b8d6f8db32dbbe4b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e8eefa98f44e8a871402c07adf11cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:08:27.974852 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-43ef96fb-d9a4-4911-8c5f-da4bb0ca4c53 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] 10.222.0.27 "GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545" status: 200 len: 1596 microversion: 2.1 time: 0.155155 Sep 20 05:08:27.975411 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 776/926] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:08:27 2022] GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545 => generated 1596 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:08:29.793765 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell0:SELECT=2 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:08:29.853156 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-ba4719bb-2310-44db-904d-f24b4956242c req-91054146-2eb5-4cf2-ae17-4f8ff4bb7356 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c57336b7-0747-4ad8-81bb-4f20fbfaa545", "tag": "9ae9a161-04f7-400c-a3d0-5448b4be5410"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:08:29.867642 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-ba4719bb-2310-44db-904d-f24b4956242c req-91054146-2eb5-4cf2-ae17-4f8ff4bb7356 service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:29.868457 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-ba4719bb-2310-44db-904d-f24b4956242c req-91054146-2eb5-4cf2-ae17-4f8ff4bb7356 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:29.870836 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-ba4719bb-2310-44db-904d-f24b4956242c req-91054146-2eb5-4cf2-ae17-4f8ff4bb7356 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:29.883441 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-ba4719bb-2310-44db-904d-f24b4956242c req-91054146-2eb5-4cf2-ae17-4f8ff4bb7356 service nova] Creating event network-changed:9ae9a161-04f7-400c-a3d0-5448b4be5410 for instance c57336b7-0747-4ad8-81bb-4f20fbfaa545 on hv-cinder-75671 Sep 20 05:08:29.891052 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-ba4719bb-2310-44db-904d-f24b4956242c req-91054146-2eb5-4cf2-ae17-4f8ff4bb7356 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103209 Sep 20 05:08:29.891664 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 777/927] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 05:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 05:08:30.790630 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-2fe78b01-ebe2-4146-ba0f-c17721111344 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-381048570"}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:08:30.791291 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-2fe78b01-ebe2-4146-ba0f-c17721111344 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] [instance: c57336b7-0747-4ad8-81bb-4f20fbfaa545] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:08:30.793784 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=4 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:08:30.800374 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2fe78b01-ebe2-4146-ba0f-c17721111344 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:30.800891 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2fe78b01-ebe2-4146-ba0f-c17721111344 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:30.801327 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2fe78b01-ebe2-4146-ba0f-c17721111344 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:30.802021 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2fe78b01-ebe2-4146-ba0f-c17721111344 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:30.802479 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2fe78b01-ebe2-4146-ba0f-c17721111344 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:30.802898 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-2fe78b01-ebe2-4146-ba0f-c17721111344 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:30.933830 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.network.security_group_api [None req-2fe78b01-ebe2-4146-ba0f-c17721111344 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Adding security group 178ba61a-ae30-41e7-aac3-122afa1e34e0 to port 9ae9a161-04f7-400c-a3d0-5448b4be5410 Sep 20 05:08:31.241949 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-2fe78b01-ebe2-4146-ba0f-c17721111344 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] 10.222.0.27 "POST /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545/action" status: 202 len: 0 microversion: 2.1 time: 0.455454 Sep 20 05:08:31.246340 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 778/928] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Sep 20 05:08:30 2022] POST /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545/action => generated 0 bytes in 461 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 20 05:08:31.251410 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-8ef9f60c-ecfa-487e-b0d7-b105fcfc4ca4 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:08:31.252053 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-8ef9f60c-ecfa-487e-b0d7-b105fcfc4ca4 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] [instance: c57336b7-0747-4ad8-81bb-4f20fbfaa545] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:08:31.258010 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8ef9f60c-ecfa-487e-b0d7-b105fcfc4ca4 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:31.258488 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8ef9f60c-ecfa-487e-b0d7-b105fcfc4ca4 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:31.258920 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8ef9f60c-ecfa-487e-b0d7-b105fcfc4ca4 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:31.259599 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8ef9f60c-ecfa-487e-b0d7-b105fcfc4ca4 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:31.260137 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8ef9f60c-ecfa-487e-b0d7-b105fcfc4ca4 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:31.260782 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-8ef9f60c-ecfa-487e-b0d7-b105fcfc4ca4 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:31.410605 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-8ef9f60c-ecfa-487e-b0d7-b105fcfc4ca4 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec291933cb14a0b8d6f8db32dbbe4b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e8eefa98f44e8a871402c07adf11cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:08:31.419513 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-8ef9f60c-ecfa-487e-b0d7-b105fcfc4ca4 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] 10.222.0.27 "GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545" status: 200 len: 1760 microversion: 2.1 time: 0.171897 Sep 20 05:08:31.420176 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 779/929] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:08:31 2022] GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545 => generated 1760 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 05:08:31.906075 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-b811992f-46ec-4fd5-9ab5-28afdecd07b3 req-59466ac2-7f89-419c-876a-ed9f6a47093a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c57336b7-0747-4ad8-81bb-4f20fbfaa545", "tag": "9ae9a161-04f7-400c-a3d0-5448b4be5410"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:08:31.915880 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-b811992f-46ec-4fd5-9ab5-28afdecd07b3 req-59466ac2-7f89-419c-876a-ed9f6a47093a service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:31.916361 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-b811992f-46ec-4fd5-9ab5-28afdecd07b3 req-59466ac2-7f89-419c-876a-ed9f6a47093a service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:31.916834 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-b811992f-46ec-4fd5-9ab5-28afdecd07b3 req-59466ac2-7f89-419c-876a-ed9f6a47093a service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:31.927779 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-b811992f-46ec-4fd5-9ab5-28afdecd07b3 req-59466ac2-7f89-419c-876a-ed9f6a47093a service nova] Creating event network-changed:9ae9a161-04f7-400c-a3d0-5448b4be5410 for instance c57336b7-0747-4ad8-81bb-4f20fbfaa545 on hv-cinder-75671 Sep 20 05:08:31.932453 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-b811992f-46ec-4fd5-9ab5-28afdecd07b3 req-59466ac2-7f89-419c-876a-ed9f6a47093a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030040 Sep 20 05:08:31.933063 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 780/930] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 05:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 05:08:35.263637 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 20 05:08:35.264251 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: Tue Sep 20 05:08:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.27) !!! Sep 20 05:08:53.968887 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_api:SELECT=5 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:08:53.969629 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:08:53.973904 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-c1b2265d-8f3a-452c-8252-a9749b734c7e tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:08:53.976151 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-c1b2265d-8f3a-452c-8252-a9749b734c7e tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] [instance: c57336b7-0747-4ad8-81bb-4f20fbfaa545] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:08:53.983876 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c1b2265d-8f3a-452c-8252-a9749b734c7e tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:53.984360 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c1b2265d-8f3a-452c-8252-a9749b734c7e tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:53.984820 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c1b2265d-8f3a-452c-8252-a9749b734c7e tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:53.985497 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c1b2265d-8f3a-452c-8252-a9749b734c7e tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:53.985939 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c1b2265d-8f3a-452c-8252-a9749b734c7e tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:53.986352 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-c1b2265d-8f3a-452c-8252-a9749b734c7e tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:54.057158 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-c1b2265d-8f3a-452c-8252-a9749b734c7e tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] 10.222.0.27 "POST /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545/action" status: 202 len: 0 microversion: 2.1 time: 0.090003 Sep 20 05:08:54.057790 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 781/931] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Sep 20 05:08:53 2022] POST /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 20 05:08:54.066566 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-4a53c885-e066-44d0-bb47-ab234c6a0fb7 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:08:54.067283 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-4a53c885-e066-44d0-bb47-ab234c6a0fb7 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] [instance: c57336b7-0747-4ad8-81bb-4f20fbfaa545] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:08:54.073612 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4a53c885-e066-44d0-bb47-ab234c6a0fb7 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:54.074137 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4a53c885-e066-44d0-bb47-ab234c6a0fb7 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:54.074660 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4a53c885-e066-44d0-bb47-ab234c6a0fb7 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:54.075423 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4a53c885-e066-44d0-bb47-ab234c6a0fb7 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:54.075881 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4a53c885-e066-44d0-bb47-ab234c6a0fb7 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:54.076295 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4a53c885-e066-44d0-bb47-ab234c6a0fb7 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:54.223152 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-4a53c885-e066-44d0-bb47-ab234c6a0fb7 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec291933cb14a0b8d6f8db32dbbe4b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e8eefa98f44e8a871402c07adf11cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:08:54.231423 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-4a53c885-e066-44d0-bb47-ab234c6a0fb7 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] 10.222.0.27 "GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545" status: 200 len: 1752 microversion: 2.1 time: 0.169216 Sep 20 05:08:54.231974 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 782/932] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:08:54 2022] GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545 => generated 1752 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:08:55.255294 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-452c2a0b-cf29-45fa-92b7-e495d7bb7399 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:08:55.256062 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-452c2a0b-cf29-45fa-92b7-e495d7bb7399 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] [instance: c57336b7-0747-4ad8-81bb-4f20fbfaa545] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:08:55.262738 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-452c2a0b-cf29-45fa-92b7-e495d7bb7399 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:55.263215 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-452c2a0b-cf29-45fa-92b7-e495d7bb7399 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:55.263641 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-452c2a0b-cf29-45fa-92b7-e495d7bb7399 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:55.264327 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-452c2a0b-cf29-45fa-92b7-e495d7bb7399 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:55.264908 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-452c2a0b-cf29-45fa-92b7-e495d7bb7399 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:55.265323 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-452c2a0b-cf29-45fa-92b7-e495d7bb7399 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:55.401921 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-452c2a0b-cf29-45fa-92b7-e495d7bb7399 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec291933cb14a0b8d6f8db32dbbe4b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e8eefa98f44e8a871402c07adf11cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:08:55.410531 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-452c2a0b-cf29-45fa-92b7-e495d7bb7399 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] 10.222.0.27 "GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545" status: 200 len: 1757 microversion: 2.1 time: 0.159076 Sep 20 05:08:55.411028 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 783/933] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:08:55 2022] GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545 => generated 1757 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:08:56.434509 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-6d2b94b3-f894-4a2c-bc97-218018809ee0 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:08:56.435159 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-6d2b94b3-f894-4a2c-bc97-218018809ee0 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] [instance: c57336b7-0747-4ad8-81bb-4f20fbfaa545] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:08:56.442004 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6d2b94b3-f894-4a2c-bc97-218018809ee0 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:56.442478 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6d2b94b3-f894-4a2c-bc97-218018809ee0 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:56.442910 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6d2b94b3-f894-4a2c-bc97-218018809ee0 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:56.443584 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6d2b94b3-f894-4a2c-bc97-218018809ee0 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:56.444030 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6d2b94b3-f894-4a2c-bc97-218018809ee0 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:56.444448 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-6d2b94b3-f894-4a2c-bc97-218018809ee0 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:56.585888 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-6d2b94b3-f894-4a2c-bc97-218018809ee0 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec291933cb14a0b8d6f8db32dbbe4b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e8eefa98f44e8a871402c07adf11cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:08:56.594018 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-6d2b94b3-f894-4a2c-bc97-218018809ee0 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] 10.222.0.27 "GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545" status: 200 len: 1757 microversion: 2.1 time: 0.163407 Sep 20 05:08:56.594577 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 784/934] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:08:56 2022] GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:08:57.617548 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-905c05ac-d3c6-4186-bf91-398d9bbd3eca tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:08:57.618253 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-905c05ac-d3c6-4186-bf91-398d9bbd3eca tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] [instance: c57336b7-0747-4ad8-81bb-4f20fbfaa545] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:08:57.624962 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-905c05ac-d3c6-4186-bf91-398d9bbd3eca tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:57.625445 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-905c05ac-d3c6-4186-bf91-398d9bbd3eca tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:57.625879 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-905c05ac-d3c6-4186-bf91-398d9bbd3eca tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:57.626569 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-905c05ac-d3c6-4186-bf91-398d9bbd3eca tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:57.627018 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-905c05ac-d3c6-4186-bf91-398d9bbd3eca tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:57.627438 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-905c05ac-d3c6-4186-bf91-398d9bbd3eca tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:57.919879 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-905c05ac-d3c6-4186-bf91-398d9bbd3eca tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec291933cb14a0b8d6f8db32dbbe4b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e8eefa98f44e8a871402c07adf11cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:08:57.928561 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-905c05ac-d3c6-4186-bf91-398d9bbd3eca tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] 10.222.0.27 "GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545" status: 200 len: 1757 microversion: 2.1 time: 0.315044 Sep 20 05:08:57.929131 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 785/935] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:08:57 2022] GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545 => generated 1757 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:08:58.951205 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-e3e54bc5-3675-41aa-8d7b-13966f17e5a2 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:08:58.952419 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-e3e54bc5-3675-41aa-8d7b-13966f17e5a2 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] [instance: c57336b7-0747-4ad8-81bb-4f20fbfaa545] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:08:58.958797 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e3e54bc5-3675-41aa-8d7b-13966f17e5a2 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:58.959275 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e3e54bc5-3675-41aa-8d7b-13966f17e5a2 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:58.959707 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e3e54bc5-3675-41aa-8d7b-13966f17e5a2 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:58.960382 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e3e54bc5-3675-41aa-8d7b-13966f17e5a2 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:08:58.960874 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e3e54bc5-3675-41aa-8d7b-13966f17e5a2 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:08:58.961297 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-e3e54bc5-3675-41aa-8d7b-13966f17e5a2 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:08:59.101937 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-e3e54bc5-3675-41aa-8d7b-13966f17e5a2 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec291933cb14a0b8d6f8db32dbbe4b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e8eefa98f44e8a871402c07adf11cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:08:59.110134 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-e3e54bc5-3675-41aa-8d7b-13966f17e5a2 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] 10.222.0.27 "GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545" status: 200 len: 1757 microversion: 2.1 time: 0.162768 Sep 20 05:08:59.110682 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 786/936] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:08:58 2022] GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:09:00.132998 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-fc4f550a-677b-46ce-86e5-215e674561f7 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:09:00.133667 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-fc4f550a-677b-46ce-86e5-215e674561f7 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] [instance: c57336b7-0747-4ad8-81bb-4f20fbfaa545] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:09:00.140112 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fc4f550a-677b-46ce-86e5-215e674561f7 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:09:00.140588 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fc4f550a-677b-46ce-86e5-215e674561f7 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:09:00.141046 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fc4f550a-677b-46ce-86e5-215e674561f7 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:09:00.141722 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fc4f550a-677b-46ce-86e5-215e674561f7 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:09:00.142164 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fc4f550a-677b-46ce-86e5-215e674561f7 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:09:00.142579 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-fc4f550a-677b-46ce-86e5-215e674561f7 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:09:00.288630 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-fc4f550a-677b-46ce-86e5-215e674561f7 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec291933cb14a0b8d6f8db32dbbe4b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e8eefa98f44e8a871402c07adf11cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:09:00.297359 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-fc4f550a-677b-46ce-86e5-215e674561f7 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] 10.222.0.27 "GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545" status: 200 len: 1757 microversion: 2.1 time: 0.168199 Sep 20 05:09:00.298120 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 787/937] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:09:00 2022] GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:09:01.319245 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-97f28540-49c4-417c-915e-2d45c5c9a62f tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:09:01.319935 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-97f28540-49c4-417c-915e-2d45c5c9a62f tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] [instance: c57336b7-0747-4ad8-81bb-4f20fbfaa545] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:09:01.326320 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-97f28540-49c4-417c-915e-2d45c5c9a62f tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:09:01.326799 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-97f28540-49c4-417c-915e-2d45c5c9a62f tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:09:01.327236 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-97f28540-49c4-417c-915e-2d45c5c9a62f tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:09:01.327914 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-97f28540-49c4-417c-915e-2d45c5c9a62f tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:09:01.328367 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-97f28540-49c4-417c-915e-2d45c5c9a62f tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:09:01.328815 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-97f28540-49c4-417c-915e-2d45c5c9a62f tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:09:01.468845 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-97f28540-49c4-417c-915e-2d45c5c9a62f tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec291933cb14a0b8d6f8db32dbbe4b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e8eefa98f44e8a871402c07adf11cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:09:01.477023 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-97f28540-49c4-417c-915e-2d45c5c9a62f tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] 10.222.0.27 "GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545" status: 200 len: 1757 microversion: 2.1 time: 0.161599 Sep 20 05:09:01.477577 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 788/938] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:09:01 2022] GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:09:02.500878 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-4746a533-fb56-432c-a656-be4a8048f430 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:09:02.501537 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-4746a533-fb56-432c-a656-be4a8048f430 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] [instance: c57336b7-0747-4ad8-81bb-4f20fbfaa545] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:09:02.507806 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4746a533-fb56-432c-a656-be4a8048f430 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:09:02.508276 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4746a533-fb56-432c-a656-be4a8048f430 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:09:02.508740 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4746a533-fb56-432c-a656-be4a8048f430 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:09:02.509416 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4746a533-fb56-432c-a656-be4a8048f430 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:09:02.509865 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4746a533-fb56-432c-a656-be4a8048f430 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:09:02.510282 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4746a533-fb56-432c-a656-be4a8048f430 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:09:02.650387 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-4746a533-fb56-432c-a656-be4a8048f430 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec291933cb14a0b8d6f8db32dbbe4b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e8eefa98f44e8a871402c07adf11cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:09:02.659390 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-4746a533-fb56-432c-a656-be4a8048f430 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] 10.222.0.27 "GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545" status: 200 len: 1757 microversion: 2.1 time: 0.163064 Sep 20 05:09:02.659941 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 789/939] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:09:02 2022] GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:09:03.682609 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-1689a300-d311-4574-994d-bda82d52805d tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:09:03.683328 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-1689a300-d311-4574-994d-bda82d52805d tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] [instance: c57336b7-0747-4ad8-81bb-4f20fbfaa545] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:09:03.690142 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1689a300-d311-4574-994d-bda82d52805d tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:09:03.690623 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1689a300-d311-4574-994d-bda82d52805d tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:09:03.691056 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1689a300-d311-4574-994d-bda82d52805d tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:09:03.691736 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1689a300-d311-4574-994d-bda82d52805d tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:09:03.692186 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1689a300-d311-4574-994d-bda82d52805d tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:09:03.692627 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1689a300-d311-4574-994d-bda82d52805d tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:09:03.829401 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-1689a300-d311-4574-994d-bda82d52805d tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec291933cb14a0b8d6f8db32dbbe4b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e8eefa98f44e8a871402c07adf11cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:09:03.837541 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-1689a300-d311-4574-994d-bda82d52805d tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] 10.222.0.27 "GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545" status: 200 len: 1757 microversion: 2.1 time: 0.158820 Sep 20 05:09:03.838101 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 790/940] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:09:03 2022] GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545 => generated 1757 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:09:04.861396 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-78148e00-2af7-41f9-9f71-879d530d15fb tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:09:04.862092 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-78148e00-2af7-41f9-9f71-879d530d15fb tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] [instance: c57336b7-0747-4ad8-81bb-4f20fbfaa545] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:09:04.868480 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-78148e00-2af7-41f9-9f71-879d530d15fb tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:09:04.868990 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-78148e00-2af7-41f9-9f71-879d530d15fb tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:09:04.869413 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-78148e00-2af7-41f9-9f71-879d530d15fb tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:09:04.870096 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-78148e00-2af7-41f9-9f71-879d530d15fb tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:09:04.870540 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-78148e00-2af7-41f9-9f71-879d530d15fb tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:09:04.870960 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-78148e00-2af7-41f9-9f71-879d530d15fb tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:09:05.015520 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-78148e00-2af7-41f9-9f71-879d530d15fb tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec291933cb14a0b8d6f8db32dbbe4b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e8eefa98f44e8a871402c07adf11cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:09:05.023947 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-78148e00-2af7-41f9-9f71-879d530d15fb tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] 10.222.0.27 "GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545" status: 200 len: 1757 microversion: 2.1 time: 0.167384 Sep 20 05:09:05.024502 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 791/941] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:09:04 2022] GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:09:06.047203 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-1f8ab60a-ddcf-470b-8a1b-676c60657d0a tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:09:06.047911 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-1f8ab60a-ddcf-470b-8a1b-676c60657d0a tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] [instance: c57336b7-0747-4ad8-81bb-4f20fbfaa545] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:09:06.055523 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1f8ab60a-ddcf-470b-8a1b-676c60657d0a tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:09:06.056008 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1f8ab60a-ddcf-470b-8a1b-676c60657d0a tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:09:06.056443 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1f8ab60a-ddcf-470b-8a1b-676c60657d0a tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:09:06.057159 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1f8ab60a-ddcf-470b-8a1b-676c60657d0a tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:09:06.057614 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1f8ab60a-ddcf-470b-8a1b-676c60657d0a tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:09:06.058039 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-1f8ab60a-ddcf-470b-8a1b-676c60657d0a tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:09:06.200240 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-1f8ab60a-ddcf-470b-8a1b-676c60657d0a tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec291933cb14a0b8d6f8db32dbbe4b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e8eefa98f44e8a871402c07adf11cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:09:06.208497 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-1f8ab60a-ddcf-470b-8a1b-676c60657d0a tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] 10.222.0.27 "GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545" status: 200 len: 1757 microversion: 2.1 time: 0.165213 Sep 20 05:09:06.209082 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 792/942] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:09:06 2022] GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:09:07.231374 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-dd045ffd-8f1c-4a34-9d92-f76e7d44d1f8 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:09:07.232070 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-dd045ffd-8f1c-4a34-9d92-f76e7d44d1f8 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] [instance: c57336b7-0747-4ad8-81bb-4f20fbfaa545] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:09:07.241295 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-dd045ffd-8f1c-4a34-9d92-f76e7d44d1f8 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:09:07.242196 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-dd045ffd-8f1c-4a34-9d92-f76e7d44d1f8 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:09:07.242809 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-dd045ffd-8f1c-4a34-9d92-f76e7d44d1f8 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:09:07.243521 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-dd045ffd-8f1c-4a34-9d92-f76e7d44d1f8 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:09:07.243986 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-dd045ffd-8f1c-4a34-9d92-f76e7d44d1f8 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:09:07.244412 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-dd045ffd-8f1c-4a34-9d92-f76e7d44d1f8 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:09:07.388838 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-dd045ffd-8f1c-4a34-9d92-f76e7d44d1f8 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec291933cb14a0b8d6f8db32dbbe4b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e8eefa98f44e8a871402c07adf11cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:09:07.397849 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-dd045ffd-8f1c-4a34-9d92-f76e7d44d1f8 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] 10.222.0.27 "GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545" status: 200 len: 1760 microversion: 2.1 time: 0.170498 Sep 20 05:09:07.398412 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 793/943] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:09:07 2022] GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545 => generated 1760 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:09:39.612312 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-d43e0cc0-b3c5-46a3-9836-69e0c5a0b728 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-381048570"}} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:09:39.613068 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-d43e0cc0-b3c5-46a3-9836-69e0c5a0b728 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] [instance: c57336b7-0747-4ad8-81bb-4f20fbfaa545] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:09:39.615080 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_api:SELECT=26 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:09:39.615902 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG dbcounter [-] [126813] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:09:39.620627 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d43e0cc0-b3c5-46a3-9836-69e0c5a0b728 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:09:39.621110 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d43e0cc0-b3c5-46a3-9836-69e0c5a0b728 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:09:39.621539 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d43e0cc0-b3c5-46a3-9836-69e0c5a0b728 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:09:39.622224 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d43e0cc0-b3c5-46a3-9836-69e0c5a0b728 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:09:39.622667 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d43e0cc0-b3c5-46a3-9836-69e0c5a0b728 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:09:39.623084 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-d43e0cc0-b3c5-46a3-9836-69e0c5a0b728 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:09:39.747189 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.network.security_group_api [None req-d43e0cc0-b3c5-46a3-9836-69e0c5a0b728 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Removing security group 178ba61a-ae30-41e7-aac3-122afa1e34e0 from port 9ae9a161-04f7-400c-a3d0-5448b4be5410 Sep 20 05:09:40.041594 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-d43e0cc0-b3c5-46a3-9836-69e0c5a0b728 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] 10.222.0.27 "POST /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545/action" status: 202 len: 0 microversion: 2.1 time: 0.434044 Sep 20 05:09:40.042215 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 794/944] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Sep 20 05:09:39 2022] POST /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545/action => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 20 05:09:40.052478 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-110e9be2-1437-4734-8a21-baf2cb2ed981 req-f813997a-5723-4470-a957-440e76d28542 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c57336b7-0747-4ad8-81bb-4f20fbfaa545", "tag": "9ae9a161-04f7-400c-a3d0-5448b4be5410"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:09:40.062684 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-110e9be2-1437-4734-8a21-baf2cb2ed981 req-f813997a-5723-4470-a957-440e76d28542 service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:09:40.062684 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-110e9be2-1437-4734-8a21-baf2cb2ed981 req-f813997a-5723-4470-a957-440e76d28542 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:09:40.063163 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-110e9be2-1437-4734-8a21-baf2cb2ed981 req-f813997a-5723-4470-a957-440e76d28542 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:09:40.075571 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-110e9be2-1437-4734-8a21-baf2cb2ed981 req-f813997a-5723-4470-a957-440e76d28542 service nova] Creating event network-changed:9ae9a161-04f7-400c-a3d0-5448b4be5410 for instance c57336b7-0747-4ad8-81bb-4f20fbfaa545 on hv-cinder-75671 Sep 20 05:09:40.080961 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-110e9be2-1437-4734-8a21-baf2cb2ed981 req-f813997a-5723-4470-a957-440e76d28542 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032099 Sep 20 05:09:40.082024 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 795/945] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 05:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 05:09:41.126914 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-21042557-633a-4a7f-b98c-71ed13b1754f tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:09:41.127526 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-21042557-633a-4a7f-b98c-71ed13b1754f tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] [instance: c57336b7-0747-4ad8-81bb-4f20fbfaa545] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:09:41.134297 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-21042557-633a-4a7f-b98c-71ed13b1754f tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:09:41.134779 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-21042557-633a-4a7f-b98c-71ed13b1754f tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:09:41.135208 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-21042557-633a-4a7f-b98c-71ed13b1754f tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:09:41.135903 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-21042557-633a-4a7f-b98c-71ed13b1754f tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:09:41.136352 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-21042557-633a-4a7f-b98c-71ed13b1754f tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:09:41.136818 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-21042557-633a-4a7f-b98c-71ed13b1754f tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:09:41.220818 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.objects.instance [None req-21042557-633a-4a7f-b98c-71ed13b1754f tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lazy-loading 'services' on Instance uuid c57336b7-0747-4ad8-81bb-4f20fbfaa545 {{(pid=126813) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 05:09:41.291508 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-21042557-633a-4a7f-b98c-71ed13b1754f tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545/os-volume_attachments/1d468c92-9b12-4544-8773-3ce604f02da0" status: 202 len: 0 microversion: 2.1 time: 0.169919 Sep 20 05:09:41.292324 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 796/946] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Sep 20 05:09:41 2022] DELETE /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545/os-volume_attachments/1d468c92-9b12-4544-8773-3ce604f02da0 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 20 05:09:41.301064 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-b1c9a52f-d6d1-48ee-ab90-23bfb3370868 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:09:41.303658 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-b1c9a52f-d6d1-48ee-ab90-23bfb3370868 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] [instance: c57336b7-0747-4ad8-81bb-4f20fbfaa545] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:09:41.310935 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b1c9a52f-d6d1-48ee-ab90-23bfb3370868 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:09:41.311402 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b1c9a52f-d6d1-48ee-ab90-23bfb3370868 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:09:41.312502 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b1c9a52f-d6d1-48ee-ab90-23bfb3370868 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:09:41.312691 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b1c9a52f-d6d1-48ee-ab90-23bfb3370868 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:09:41.313083 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b1c9a52f-d6d1-48ee-ab90-23bfb3370868 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:09:41.313524 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-b1c9a52f-d6d1-48ee-ab90-23bfb3370868 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:09:41.345075 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-b1c9a52f-d6d1-48ee-ab90-23bfb3370868 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] 10.222.0.27 "GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048477 Sep 20 05:09:41.345561 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 797/947] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Sep 20 05:09:41 2022] GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 05:09:42.096419 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-f90efb70-ca90-402c-b784-bdbc56962f8b req-a2878d85-f6b4-4b1c-b3c4-039554d37104 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c57336b7-0747-4ad8-81bb-4f20fbfaa545", "tag": "9ae9a161-04f7-400c-a3d0-5448b4be5410"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:09:42.105634 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-f90efb70-ca90-402c-b784-bdbc56962f8b req-a2878d85-f6b4-4b1c-b3c4-039554d37104 service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:09:42.106113 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-f90efb70-ca90-402c-b784-bdbc56962f8b req-a2878d85-f6b4-4b1c-b3c4-039554d37104 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:09:42.106539 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-f90efb70-ca90-402c-b784-bdbc56962f8b req-a2878d85-f6b4-4b1c-b3c4-039554d37104 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:09:42.117795 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-f90efb70-ca90-402c-b784-bdbc56962f8b req-a2878d85-f6b4-4b1c-b3c4-039554d37104 service nova] Creating event network-changed:9ae9a161-04f7-400c-a3d0-5448b4be5410 for instance c57336b7-0747-4ad8-81bb-4f20fbfaa545 on hv-cinder-75671 Sep 20 05:09:42.122487 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-f90efb70-ca90-402c-b784-bdbc56962f8b req-a2878d85-f6b4-4b1c-b3c4-039554d37104 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029792 Sep 20 05:09:42.123071 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 798/948] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 05:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 05:09:42.358083 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-524b0203-2dc3-4e79-8179-52beed483551 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:09:42.360880 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-524b0203-2dc3-4e79-8179-52beed483551 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] [instance: c57336b7-0747-4ad8-81bb-4f20fbfaa545] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:09:42.367601 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-524b0203-2dc3-4e79-8179-52beed483551 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:09:42.368079 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-524b0203-2dc3-4e79-8179-52beed483551 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:09:42.368517 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-524b0203-2dc3-4e79-8179-52beed483551 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:09:42.369235 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-524b0203-2dc3-4e79-8179-52beed483551 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:09:42.369691 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-524b0203-2dc3-4e79-8179-52beed483551 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:09:42.370111 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-524b0203-2dc3-4e79-8179-52beed483551 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:09:42.399413 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-524b0203-2dc3-4e79-8179-52beed483551 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] 10.222.0.27 "GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045526 Sep 20 05:09:42.399975 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 799/949] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Sep 20 05:09:42 2022] GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 20 05:09:42.410236 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-3e96daed-0520-4a7d-9603-56be376ddb53 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:09:42.410751 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-3e96daed-0520-4a7d-9603-56be376ddb53 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] [instance: c57336b7-0747-4ad8-81bb-4f20fbfaa545] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:09:42.416554 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3e96daed-0520-4a7d-9603-56be376ddb53 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:09:42.417067 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3e96daed-0520-4a7d-9603-56be376ddb53 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:09:42.417503 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3e96daed-0520-4a7d-9603-56be376ddb53 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:09:42.418219 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3e96daed-0520-4a7d-9603-56be376ddb53 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:09:42.418668 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3e96daed-0520-4a7d-9603-56be376ddb53 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:09:42.419094 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-3e96daed-0520-4a7d-9603-56be376ddb53 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:09:42.493551 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.wsgi [None req-3e96daed-0520-4a7d-9603-56be376ddb53 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] HTTP exception thrown: Instance c57336b7-0747-4ad8-81bb-4f20fbfaa545 is not attached to volume 1d468c92-9b12-4544-8773-3ce604f02da0 Sep 20 05:09:42.495923 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-3e96daed-0520-4a7d-9603-56be376ddb53 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Request method failure captured: Sep 20 05:09:42.495923 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: request: DELETE /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545/os-volume_attachments/1d468c92-9b12-4544-8773-3ce604f02da0 HTTP/1.1 Sep 20 05:09:42.495923 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept: application/json Sep 20 05:09:42.495923 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept-Encoding: identity Sep 20 05:09:42.495923 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Connection: close Sep 20 05:09:42.495923 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Length: 0 Sep 20 05:09:42.495923 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Type: application/json Sep 20 05:09:42.495923 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Host: 10.222.0.27 Sep 20 05:09:42.495923 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Openstack-System-Scope: None Sep 20 05:09:42.495923 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: User-Agent: python-urllib3/1.26.12 Sep 20 05:09:42.495923 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Auth-Token: gAAAAABjKUqiMwmt5yOf_cbQMl2miI3gA6Gunv50qoCfoGgzce4b5Wx76a4omm431oMW2wv0iM01pNJ590_VX2JQMkKry2lh4kEXQgEAslrSAD4Gw5bwAVQkPwTWSCpS82-1QNbqX4m75Mnm7QyWBVMR_h694VgZib2Zw7r2uNKgwqBaf6-B-6E Sep 20 05:09:42.495923 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Id: None Sep 20 05:09:42.495923 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Name: None Sep 20 05:09:42.495923 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Identity-Status: Confirmed Sep 20 05:09:42.495923 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Is-Admin-Project: True Sep 20 05:09:42.495923 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Id: default Sep 20 05:09:42.495923 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Name: Default Sep 20 05:09:42.495923 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Id: 15e8eefa98f44e8a871402c07adf11cf Sep 20 05:09:42.495923 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Name: tempest-TestMinimumBasicScenario-930919975 Sep 20 05:09:42.495923 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Role: reader,member Sep 20 05:09:42.495923 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Roles: reader,member Sep 20 05:09:42.497899 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/15e8eefa98f44e8a871402c07adf11cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/15e8eefa98f44e8a871402c07adf11cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_15e8eefa98f44e8a871402c07adf11cf", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/15e8eefa98f44e8a871402c07adf11cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 05:09:42.497899 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant: tempest-TestMinimumBasicScenario-930919975 Sep 20 05:09:42.497899 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Id: 15e8eefa98f44e8a871402c07adf11cf Sep 20 05:09:42.497899 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Name: tempest-TestMinimumBasicScenario-930919975 Sep 20 05:09:42.497899 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User: tempest-TestMinimumBasicScenario-930919975-project Sep 20 05:09:42.497899 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Id: default Sep 20 05:09:42.497899 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Name: Default Sep 20 05:09:42.497899 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Id: cec291933cb14a0b8d6f8db32dbbe4b0 Sep 20 05:09:42.497899 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Name: tempest-TestMinimumBasicScenario-930919975-project Sep 20 05:09:42.497899 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: method: > Sep 20 05:09:42.497899 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: exception: Instance c57336b7-0747-4ad8-81bb-4f20fbfaa545 is not attached to volume 1d468c92-9b12-4544-8773-3ce604f02da0 Sep 20 05:09:42.499042 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: action_args: {'server_id': 'c57336b7-0747-4ad8-81bb-4f20fbfaa545', 'id': '1d468c92-9b12-4544-8773-3ce604f02da0'} Sep 20 05:09:42.499042 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 05:09:42.499042 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:09:42.499042 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 20 05:09:42.499042 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 20 05:09:42.499042 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 20 05:09:42.499042 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 20 05:09:42.499042 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 20 05:09:42.499042 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 20 05:09:42.499042 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 1d468c92-9b12-4544-8773-3ce604f02da0. Sep 20 05:09:42.499042 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:09:42.499042 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 05:09:42.499042 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:09:42.499042 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:09:42.499042 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 05:09:42.499042 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 05:09:42.499042 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 05:09:42.499042 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 05:09:42.499042 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 05:09:42.500701 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 05:09:42.500701 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 20 05:09:42.500701 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 20 05:09:42.500701 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c57336b7-0747-4ad8-81bb-4f20fbfaa545 is not attached to volume 1d468c92-9b12-4544-8773-3ce604f02da0 Sep 20 05:09:42.500701 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:09:42.500701 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 05:09:42.500701 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:09:42.500701 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:09:42.500701 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 05:09:42.500701 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 05:09:42.500701 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 05:09:42.500701 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 05:09:42.500701 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c57336b7-0747-4ad8-81bb-4f20fbfaa545 is not attached to volume 1d468c92-9b12-4544-8773-3ce604f02da0 Sep 20 05:09:42.500701 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:09:42.500701 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-3e96daed-0520-4a7d-9603-56be376ddb53 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Returning 404 to user: Instance c57336b7-0747-4ad8-81bb-4f20fbfaa545 is not attached to volume 1d468c92-9b12-4544-8773-3ce604f02da0 {{(pid=126813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 05:09:42.502050 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-3e96daed-0520-4a7d-9603-56be376ddb53 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545/os-volume_attachments/1d468c92-9b12-4544-8773-3ce604f02da0" status: 404 len: 154 microversion: 2.1 time: 0.090904 Sep 20 05:09:42.502050 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 800/950] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Sep 20 05:09:42 2022] DELETE /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545/os-volume_attachments/1d468c92-9b12-4544-8773-3ce604f02da0 => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 20 05:09:43.639373 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-070ebae9-c457-4302-b2f4-8b9fd7b5edfb tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:09:43.639963 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-070ebae9-c457-4302-b2f4-8b9fd7b5edfb tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] [instance: c57336b7-0747-4ad8-81bb-4f20fbfaa545] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:09:43.646758 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-070ebae9-c457-4302-b2f4-8b9fd7b5edfb tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:09:43.647502 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-070ebae9-c457-4302-b2f4-8b9fd7b5edfb tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:09:43.647936 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-070ebae9-c457-4302-b2f4-8b9fd7b5edfb tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:09:43.648646 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-070ebae9-c457-4302-b2f4-8b9fd7b5edfb tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:09:43.649130 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-070ebae9-c457-4302-b2f4-8b9fd7b5edfb tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:09:43.649556 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-070ebae9-c457-4302-b2f4-8b9fd7b5edfb tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:09:43.676677 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-070ebae9-c457-4302-b2f4-8b9fd7b5edfb tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] [instance: c57336b7-0747-4ad8-81bb-4f20fbfaa545] Going to try to terminate instance {{(pid=126813) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 20 05:09:43.752170 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-070ebae9-c457-4302-b2f4-8b9fd7b5edfb tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545" status: 204 len: 0 microversion: 2.1 time: 0.116086 Sep 20 05:09:43.752859 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 801/951] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Sep 20 05:09:43 2022] DELETE /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 20 05:09:43.761443 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-50ec394d-1393-47ea-aa20-b211b01dfb2b tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:09:43.762141 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-50ec394d-1393-47ea-aa20-b211b01dfb2b tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] [instance: c57336b7-0747-4ad8-81bb-4f20fbfaa545] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:09:43.768386 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-50ec394d-1393-47ea-aa20-b211b01dfb2b tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:09:43.768896 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-50ec394d-1393-47ea-aa20-b211b01dfb2b tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:09:43.769335 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-50ec394d-1393-47ea-aa20-b211b01dfb2b tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:09:43.770027 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-50ec394d-1393-47ea-aa20-b211b01dfb2b tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:09:43.770481 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-50ec394d-1393-47ea-aa20-b211b01dfb2b tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:09:43.770911 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-50ec394d-1393-47ea-aa20-b211b01dfb2b tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:09:43.900976 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-50ec394d-1393-47ea-aa20-b211b01dfb2b tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec291933cb14a0b8d6f8db32dbbe4b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e8eefa98f44e8a871402c07adf11cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:09:43.909486 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-50ec394d-1393-47ea-aa20-b211b01dfb2b tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] 10.222.0.27 "GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545" status: 200 len: 1556 microversion: 2.1 time: 0.152061 Sep 20 05:09:43.910044 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 802/952] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:09:43 2022] GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545 => generated 1556 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 05:09:44.932517 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-437b4b4d-43bb-4916-905c-ba4427fa4c20 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:09:44.933269 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-437b4b4d-43bb-4916-905c-ba4427fa4c20 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] [instance: c57336b7-0747-4ad8-81bb-4f20fbfaa545] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:09:44.939647 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-437b4b4d-43bb-4916-905c-ba4427fa4c20 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:09:44.940130 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-437b4b4d-43bb-4916-905c-ba4427fa4c20 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:09:44.940569 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-437b4b4d-43bb-4916-905c-ba4427fa4c20 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:09:44.941276 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-437b4b4d-43bb-4916-905c-ba4427fa4c20 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:09:44.941725 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-437b4b4d-43bb-4916-905c-ba4427fa4c20 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:09:44.942150 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-437b4b4d-43bb-4916-905c-ba4427fa4c20 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:09:45.067075 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-437b4b4d-43bb-4916-905c-ba4427fa4c20 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec291933cb14a0b8d6f8db32dbbe4b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e8eefa98f44e8a871402c07adf11cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:09:45.074739 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-437b4b4d-43bb-4916-905c-ba4427fa4c20 tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] 10.222.0.27 "GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545" status: 200 len: 1556 microversion: 2.1 time: 0.146204 Sep 20 05:09:45.075296 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 803/953] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:09:44 2022] GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545 => generated 1556 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:09:46.098557 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-a6f76e6a-a1f9-4b17-b085-40771459c9ce tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:09:46.099162 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-a6f76e6a-a1f9-4b17-b085-40771459c9ce tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] [instance: c57336b7-0747-4ad8-81bb-4f20fbfaa545] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:09:46.105867 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a6f76e6a-a1f9-4b17-b085-40771459c9ce tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:09:46.106328 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a6f76e6a-a1f9-4b17-b085-40771459c9ce tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:09:46.106763 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a6f76e6a-a1f9-4b17-b085-40771459c9ce tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:09:46.107456 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a6f76e6a-a1f9-4b17-b085-40771459c9ce tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:09:46.107938 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a6f76e6a-a1f9-4b17-b085-40771459c9ce tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:09:46.108360 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-a6f76e6a-a1f9-4b17-b085-40771459c9ce tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:09:46.171413 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.policy [None req-a6f76e6a-a1f9-4b17-b085-40771459c9ce tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec291933cb14a0b8d6f8db32dbbe4b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e8eefa98f44e8a871402c07adf11cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126813) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 05:09:46.179367 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-a6f76e6a-a1f9-4b17-b085-40771459c9ce tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] 10.222.0.27 "GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545" status: 200 len: 1514 microversion: 2.1 time: 0.084935 Sep 20 05:09:46.179935 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 804/954] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:09:46 2022] GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545 => generated 1514 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 05:09:46.184270 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [req-fd1c664c-af0b-42bd-b237-c013e6252a41 req-9b003222-d6e9-468f-b7ea-7cac9dc34601 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c57336b7-0747-4ad8-81bb-4f20fbfaa545", "name": "network-vif-deleted", "tag": "9ae9a161-04f7-400c-a3d0-5448b4be5410"}]} {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 05:09:46.193602 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-fd1c664c-af0b-42bd-b237-c013e6252a41 req-9b003222-d6e9-468f-b7ea-7cac9dc34601 service nova] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:09:46.194074 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-fd1c664c-af0b-42bd-b237-c013e6252a41 req-9b003222-d6e9-468f-b7ea-7cac9dc34601 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:09:46.194501 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [req-fd1c664c-af0b-42bd-b237-c013e6252a41 req-9b003222-d6e9-468f-b7ea-7cac9dc34601 service nova] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:09:46.205527 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.compute.server_external_events [req-fd1c664c-af0b-42bd-b237-c013e6252a41 req-9b003222-d6e9-468f-b7ea-7cac9dc34601 service nova] Creating event network-vif-deleted:9ae9a161-04f7-400c-a3d0-5448b4be5410 for instance c57336b7-0747-4ad8-81bb-4f20fbfaa545 on hv-cinder-75671 Sep 20 05:09:46.210190 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [req-fd1c664c-af0b-42bd-b237-c013e6252a41 req-9b003222-d6e9-468f-b7ea-7cac9dc34601 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029195 Sep 20 05:09:46.210981 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 805/955] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Sep 20 05:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 05:09:47.203163 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-4bcdc3df-6c09-445b-b17b-6d6761f5687d tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Calling method '>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:09:47.203863 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.compute.api [None req-4bcdc3df-6c09-445b-b17b-6d6761f5687d tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] [instance: c57336b7-0747-4ad8-81bb-4f20fbfaa545] Fetching instance by UUID {{(pid=126813) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 05:09:47.210074 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4bcdc3df-6c09-445b-b17b-6d6761f5687d tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:09:47.210553 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4bcdc3df-6c09-445b-b17b-6d6761f5687d tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:09:47.210989 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4bcdc3df-6c09-445b-b17b-6d6761f5687d tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:09:47.211674 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4bcdc3df-6c09-445b-b17b-6d6761f5687d tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Acquiring lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 05:09:47.212119 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4bcdc3df-6c09-445b-b17b-6d6761f5687d tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 05:09:47.212549 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG oslo_concurrency.lockutils [None req-4bcdc3df-6c09-445b-b17b-6d6761f5687d tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Lock "83c9afcc-a13c-497b-8ad2-720b11fbf77b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 05:09:47.226125 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.wsgi [None req-4bcdc3df-6c09-445b-b17b-6d6761f5687d tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] HTTP exception thrown: Instance c57336b7-0747-4ad8-81bb-4f20fbfaa545 could not be found. Sep 20 05:09:47.227723 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-4bcdc3df-6c09-445b-b17b-6d6761f5687d tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Request method failure captured: Sep 20 05:09:47.227723 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: request: GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545 HTTP/1.1 Sep 20 05:09:47.227723 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept: application/json Sep 20 05:09:47.227723 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Accept-Encoding: identity Sep 20 05:09:47.227723 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Connection: close Sep 20 05:09:47.227723 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Length: 0 Sep 20 05:09:47.227723 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Content-Type: application/json Sep 20 05:09:47.227723 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Host: 10.222.0.27 Sep 20 05:09:47.227723 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: Openstack-System-Scope: None Sep 20 05:09:47.227723 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: User-Agent: python-urllib3/1.26.12 Sep 20 05:09:47.227723 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Auth-Token: gAAAAABjKUqiMwmt5yOf_cbQMl2miI3gA6Gunv50qoCfoGgzce4b5Wx76a4omm431oMW2wv0iM01pNJ590_VX2JQMkKry2lh4kEXQgEAslrSAD4Gw5bwAVQkPwTWSCpS82-1QNbqX4m75Mnm7QyWBVMR_h694VgZib2Zw7r2uNKgwqBaf6-B-6E Sep 20 05:09:47.227723 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Id: None Sep 20 05:09:47.227723 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Domain-Name: None Sep 20 05:09:47.227723 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Identity-Status: Confirmed Sep 20 05:09:47.227723 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Is-Admin-Project: True Sep 20 05:09:47.227723 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Id: default Sep 20 05:09:47.227723 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Domain-Name: Default Sep 20 05:09:47.227723 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Id: 15e8eefa98f44e8a871402c07adf11cf Sep 20 05:09:47.227723 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Project-Name: tempest-TestMinimumBasicScenario-930919975 Sep 20 05:09:47.227723 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Role: reader,member Sep 20 05:09:47.227723 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Roles: reader,member Sep 20 05:09:47.229324 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/15e8eefa98f44e8a871402c07adf11cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/15e8eefa98f44e8a871402c07adf11cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_15e8eefa98f44e8a871402c07adf11cf", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/15e8eefa98f44e8a871402c07adf11cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Sep 20 05:09:47.229324 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant: tempest-TestMinimumBasicScenario-930919975 Sep 20 05:09:47.229324 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Id: 15e8eefa98f44e8a871402c07adf11cf Sep 20 05:09:47.229324 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-Tenant-Name: tempest-TestMinimumBasicScenario-930919975 Sep 20 05:09:47.229324 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User: tempest-TestMinimumBasicScenario-930919975-project Sep 20 05:09:47.229324 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Id: default Sep 20 05:09:47.229324 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Domain-Name: Default Sep 20 05:09:47.229324 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Id: cec291933cb14a0b8d6f8db32dbbe4b0 Sep 20 05:09:47.229324 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: X-User-Name: tempest-TestMinimumBasicScenario-930919975-project Sep 20 05:09:47.229324 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: method: > Sep 20 05:09:47.229324 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: exception: Instance c57336b7-0747-4ad8-81bb-4f20fbfaa545 could not be found. Sep 20 05:09:47.229324 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: action_args: {'id': 'c57336b7-0747-4ad8-81bb-4f20fbfaa545'} Sep 20 05:09:47.230276 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 05:09:47.230276 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:09:47.230276 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 05:09:47.230276 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 05:09:47.230276 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 05:09:47.230276 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 05:09:47.230276 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 05:09:47.230276 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 05:09:47.230276 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 05:09:47.230276 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 05:09:47.230276 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c57336b7-0747-4ad8-81bb-4f20fbfaa545 could not be found. Sep 20 05:09:47.230276 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:09:47.230276 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 05:09:47.230276 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:09:47.230276 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:09:47.230276 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 05:09:47.230276 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 05:09:47.230276 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 05:09:47.230276 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 05:09:47.230276 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 05:09:47.231979 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 05:09:47.231979 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 05:09:47.231979 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 05:09:47.231979 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 05:09:47.231979 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 05:09:47.231979 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 05:09:47.231979 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 05:09:47.231979 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c57336b7-0747-4ad8-81bb-4f20fbfaa545 could not be found. Sep 20 05:09:47.231979 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:09:47.231979 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 05:09:47.231979 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:09:47.231979 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 05:09:47.231979 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 05:09:47.231979 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 05:09:47.231979 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 05:09:47.231979 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 05:09:47.231979 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c57336b7-0747-4ad8-81bb-4f20fbfaa545 could not be found. Sep 20 05:09:47.231979 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: ERROR nova.api.openstack.wsgi Sep 20 05:09:47.233694 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-4bcdc3df-6c09-445b-b17b-6d6761f5687d tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Returning 404 to user: Instance c57336b7-0747-4ad8-81bb-4f20fbfaa545 could not be found. {{(pid=126813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 05:09:47.233694 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-4bcdc3df-6c09-445b-b17b-6d6761f5687d tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] 10.222.0.27 "GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545" status: 404 len: 111 microversion: 2.1 time: 0.030728 Sep 20 05:09:47.233694 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 806/956] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Sep 20 05:09:47 2022] GET /compute/v2.1/servers/c57336b7-0747-4ad8-81bb-4f20fbfaa545 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 20 05:09:47.237717 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: DEBUG nova.api.openstack.wsgi [None req-e23e3062-0cc5-445e-8321-b2a3c62224da tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] Calling method '.version_select at 0x7f2e4a7405e0>' {{(pid=126813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 05:09:47.255833 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: INFO nova.api.openstack.requestlog [None req-e23e3062-0cc5-445e-8321-b2a3c62224da tempest-TestMinimumBasicScenario-930919975 tempest-TestMinimumBasicScenario-930919975-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1813333039" status: 202 len: 0 microversion: 2.1 time: 0.022096 Sep 20 05:09:47.256383 dv-cinder-756710-7-iscsi devstack@n-api.service[126813]: [pid: 126813|app: 0|req: 807/957] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Sep 20 05:09:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1813333039 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 20 05:09:51.226930 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG neutronclient.v2_0.client [None req-587c3dda-b90e-4d73-9f6d-d4c4f7cca5a9 tempest-TestShelveInstance-175665765 tempest-TestShelveInstance-175665765-project] Error message: {"error": {"code": 401, "title": "Unauthorized", "message": "The request you have made requires authentication."}} {{(pid=126814) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 20 05:09:51.227455 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack.requestlog [None req-587c3dda-b90e-4d73-9f6d-d4c4f7cca5a9 tempest-TestShelveInstance-175665765 tempest-TestShelveInstance-175665765-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 500 len: 0 microversion: 2.1 time: 891.479075 Sep 20 05:09:51.271271 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack [None req-587c3dda-b90e-4d73-9f6d-d4c4f7cca5a9 tempest-TestShelveInstance-175665765 tempest-TestShelveInstance-175665765-project] Caught error: Not authorized.: nova.exception.Unauthorized: Not authorized. Sep 20 05:09:51.271271 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack Traceback (most recent call last): Sep 20 05:09:51.271271 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Sep 20 05:09:51.271271 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack return self.find_resource_by_id(resource, name_or_id, Sep 20 05:09:51.271271 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 20 05:09:51.271271 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Sep 20 05:09:51.271271 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Sep 20 05:09:51.271271 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack raise exceptions.NotFound(message=not_found_message) Sep 20 05:09:51.271271 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'tempest-secgroup-smoke-47953344' Sep 20 05:09:51.271271 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack Sep 20 05:09:51.271271 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack During handling of the above exception, another exception occurred: Sep 20 05:09:51.271271 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack Sep 20 05:09:51.271271 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack Traceback (most recent call last): Sep 20 05:09:51.271271 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 20 05:09:51.271271 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Sep 20 05:09:51.271271 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 20 05:09:51.271271 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack exception_handler_v20(status_code, error_body) Sep 20 05:09:51.271271 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 20 05:09:51.273236 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack raise client_exc(message=error_message, Sep 20 05:09:51.273236 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack neutronclient.common.exceptions.Unauthorized: 401-{'error': {'code': 401, 'title': 'Unauthorized', 'message': 'The request you have made requires authentication.'}} Sep 20 05:09:51.273236 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack Neutron server returns request_ids: ['req-3caff42c-55fc-4f59-a8c7-5e162bb0bf79'] Sep 20 05:09:51.273236 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack Sep 20 05:09:51.273236 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack During handling of the above exception, another exception occurred: Sep 20 05:09:51.273236 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack Sep 20 05:09:51.273236 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack Traceback (most recent call last): Sep 20 05:09:51.273236 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/__init__.py", line 95, in __call__ Sep 20 05:09:51.273236 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack return req.get_response(self.application) Sep 20 05:09:51.273236 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Sep 20 05:09:51.273236 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Sep 20 05:09:51.273236 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Sep 20 05:09:51.273236 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Sep 20 05:09:51.273236 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Sep 20 05:09:51.273236 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Sep 20 05:09:51.273236 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Sep 20 05:09:51.273236 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Sep 20 05:09:51.273236 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/requestlog.py", line 104, in __call__ Sep 20 05:09:51.273236 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack self._log_req(req, res, start) Sep 20 05:09:51.273236 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 20 05:09:51.274906 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack self.force_reraise() Sep 20 05:09:51.274906 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 20 05:09:51.274906 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack raise self.value Sep 20 05:09:51.274906 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/requestlog.py", line 99, in __call__ Sep 20 05:09:51.274906 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack res = req.get_response(self.application) Sep 20 05:09:51.274906 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Sep 20 05:09:51.274906 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Sep 20 05:09:51.274906 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Sep 20 05:09:51.274906 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Sep 20 05:09:51.274906 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Sep 20 05:09:51.274906 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack return resp(environ, start_response) Sep 20 05:09:51.274906 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Sep 20 05:09:51.274906 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Sep 20 05:09:51.274906 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Sep 20 05:09:51.274906 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Sep 20 05:09:51.274906 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/osprofiler/web.py", line 111, in __call__ Sep 20 05:09:51.274906 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack return request.get_response(self.application) Sep 20 05:09:51.274906 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Sep 20 05:09:51.274906 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Sep 20 05:09:51.276485 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Sep 20 05:09:51.276485 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Sep 20 05:09:51.276485 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Sep 20 05:09:51.276485 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Sep 20 05:09:51.276485 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Sep 20 05:09:51.276485 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Sep 20 05:09:51.276485 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py", line 341, in __call__ Sep 20 05:09:51.276485 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack response = req.get_response(self._app) Sep 20 05:09:51.276485 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Sep 20 05:09:51.276485 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Sep 20 05:09:51.276485 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Sep 20 05:09:51.276485 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Sep 20 05:09:51.276485 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Sep 20 05:09:51.276485 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack return resp(environ, start_response) Sep 20 05:09:51.276485 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Sep 20 05:09:51.276485 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack return resp(environ, start_response) Sep 20 05:09:51.276485 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/routes/middleware.py", line 153, in __call__ Sep 20 05:09:51.276485 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack response = self.app(environ, start_response) Sep 20 05:09:51.278504 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Sep 20 05:09:51.278504 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack return resp(environ, start_response) Sep 20 05:09:51.278504 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Sep 20 05:09:51.278504 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Sep 20 05:09:51.278504 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Sep 20 05:09:51.278504 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Sep 20 05:09:51.278504 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 486, in __call__ Sep 20 05:09:51.278504 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack return self._process_stack(request, action, action_args, Sep 20 05:09:51.278504 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 05:09:51.278504 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack action_result = self.dispatch(meth, request, action_args) Sep 20 05:09:51.278504 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 05:09:51.278504 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack return method(req=request, **action_args) Sep 20 05:09:51.278504 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 05:09:51.278504 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack return f(*args, **kwargs) Sep 20 05:09:51.278504 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 20 05:09:51.278504 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack return func(*args, **kwargs) Sep 20 05:09:51.278504 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 20 05:09:51.278504 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack return func(*args, **kwargs) Sep 20 05:09:51.278504 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 20 05:09:51.278504 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack return func(*args, **kwargs) Sep 20 05:09:51.280229 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack [Previous line repeated 10 more times] Sep 20 05:09:51.280229 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 20 05:09:51.280229 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack instances, resv_id = self.compute_api.create( Sep 20 05:09:51.280229 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 20 05:09:51.280229 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack return self._create_instance( Sep 20 05:09:51.280229 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Sep 20 05:09:51.280229 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack ) = self._validate_and_build_base_options( Sep 20 05:09:51.280229 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Sep 20 05:09:51.280229 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack security_groups = self._check_requested_secgroups( Sep 20 05:09:51.280229 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Sep 20 05:09:51.280229 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack secgroup_uuid = security_group_api.validate_name(context, secgroup) Sep 20 05:09:51.280229 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Sep 20 05:09:51.280229 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack return neutronv20.find_resourceid_by_name_or_id( Sep 20 05:09:51.280229 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Sep 20 05:09:51.280229 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack return find_resource_by_name_or_id(client, resource, name_or_id, Sep 20 05:09:51.280229 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Sep 20 05:09:51.280229 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack return client.find_resource(resource, name_or_id, project_id, Sep 20 05:09:51.280229 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 20 05:09:51.281801 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Sep 20 05:09:51.281801 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Sep 20 05:09:51.281801 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack return self._find_resource_by_name( Sep 20 05:09:51.281801 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 20 05:09:51.281801 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Sep 20 05:09:51.281801 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 457, in _find_resource_by_name Sep 20 05:09:51.281801 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack data = obj_lister(**params) Sep 20 05:09:51.281801 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 20 05:09:51.281801 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Sep 20 05:09:51.281801 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1063, in list_security_groups Sep 20 05:09:51.281801 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack return self.list('security_groups', self.security_groups_path, Sep 20 05:09:51.281801 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 20 05:09:51.281801 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Sep 20 05:09:51.281801 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 372, in list Sep 20 05:09:51.281801 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack for r in self._pagination(collection, path, **params): Sep 20 05:09:51.281801 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 387, in _pagination Sep 20 05:09:51.281801 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack res = self.get(path, params=params) Sep 20 05:09:51.281801 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 20 05:09:51.281801 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Sep 20 05:09:51.283394 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 20 05:09:51.283394 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack return self.retry_request("GET", action, body=body, Sep 20 05:09:51.283394 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 20 05:09:51.283394 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Sep 20 05:09:51.283394 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 20 05:09:51.283394 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack return self.do_request(method, action, body=body, Sep 20 05:09:51.283394 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 20 05:09:51.283394 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Sep 20 05:09:51.283394 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 20 05:09:51.283394 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack self._handle_fault_response(status_code, replybody, resp) Sep 20 05:09:51.283394 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 204, in wrapper Sep 20 05:09:51.283394 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack raise exception.Unauthorized() Sep 20 05:09:51.283394 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack nova.exception.Unauthorized: Not authorized. Sep 20 05:09:51.283394 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova.api.openstack Sep 20 05:09:51.283394 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: INFO nova.api.openstack [None req-587c3dda-b90e-4d73-9f6d-d4c4f7cca5a9 tempest-TestShelveInstance-175665765 tempest-TestShelveInstance-175665765-project] http://10.222.0.27/compute/v2.1/servers returned with HTTP 401 Sep 20 05:09:51.284681 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: DEBUG nova.api.openstack.wsgi [None req-587c3dda-b90e-4d73-9f6d-d4c4f7cca5a9 tempest-TestShelveInstance-175665765 tempest-TestShelveInstance-175665765-project] Returning 401 to user: This server could not verify that you are authorized to access the document you requested. Either you supplied the wrong credentials (e.g., bad password), or your browser does not understand how to supply the credentials required. {{(pid=126814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 05:09:51.284681 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: Tue Sep 20 05:09:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.27) !!! Sep 20 05:09:51.284681 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: Tue Sep 20 05:09:51 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during POST /compute/v2.1/servers (10.222.0.27) Sep 20 05:09:51.284681 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: CRITICAL nova [None req-587c3dda-b90e-4d73-9f6d-d4c4f7cca5a9 tempest-TestShelveInstance-175665765 tempest-TestShelveInstance-175665765-project] Unhandled error: OSError: write error Sep 20 05:09:51.284681 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova OSError: write error Sep 20 05:09:51.284681 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: ERROR nova Sep 20 05:09:51.284681 dv-cinder-756710-7-iscsi devstack@n-api.service[126814]: [pid: 126814|app: 0|req: 151/958] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Sep 20 04:54:59 2022] POST /compute/v2.1/servers => generated 0 bytes in 891527 msecs (HTTP/1.1 401) 9 headers in 0 bytes (0 switches on core 0)